Sep 23 00:03:58 devstack cinder-volume[75403]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:03:58 devstack cinder-volume[75403]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:03:58 devstack cinder-volume[75403]: we strongly recommend against using it for new projects. Sep 23 00:03:58 devstack cinder-volume[75403]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:03:58 devstack cinder-volume[75403]: framework. For more detail see Sep 23 00:03:58 devstack cinder-volume[75403]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:03:58 devstack cinder-volume[75403]: import eventlet # noqa Sep 23 00:04:01 devstack cinder-volume[75403]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75403) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:04:01 devstack cinder-volume[75403]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75403) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:04:01 devstack cinder-volume[75403]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75403) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:04:02 devstack cinder-volume[75403]: INFO dbcounter [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Registered counter for database cinder Sep 23 00:04:02 devstack cinder-volume[75403]: DEBUG oslo_db.sqlalchemy.engines [None req-a9abecf3-43de-473a-bd94-58988086932b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75403) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:04:02 devstack cinder-volume[75403]: DEBUG dbcounter [-] [75403] Writer thread running {{(pid=75403) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:04:02 devstack cinder-volume[75403]: INFO cinder.rpc [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:04:02 devstack cinder-volume[75403]: INFO cinder.rpc [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:04:02 devstack cinder-volume[75403]: DEBUG oslo_db.sqlalchemy.engines [None req-a9abecf3-43de-473a-bd94-58988086932b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75403) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:04:02 devstack cinder-volume[75403]: INFO cinder.volume.manager [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Determined volume DB was empty at startup. Sep 23 00:04:02 devstack cinder-volume[75403]: DEBUG cinder.volume.manager [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75403) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:04:02 devstack cinder-volume[75403]: INFO cinder.volume.manager [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 00:04:02 devstack cinder-volume[75403]: WARNING stevedore.named [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:04:02 devstack cinder-volume[75403]: WARNING castellan.key_manager [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:04:02 devstack cinder-volume[75403]: WARNING cinder.keymgr.conf_key_mgr [None req-a9abecf3-43de-473a-bd94-58988086932b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:04:02 devstack cinder-volume[75403]: DEBUG cinder.volume.drivers.lvm [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75403) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 23 00:04:02 devstack cinder-volume[75403]: DEBUG oslo_concurrency.processutils [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_concurrency.processutils [None req-a9abecf3-43de-473a-bd94-58988086932b None None] CMD "cinder-rtstool verify" returned: 0 in 0.530s {{(pid=75403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_db.sqlalchemy.engines [None req-a9abecf3-43de-473a-bd94-58988086932b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75403) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:04:03 devstack cinder-volume[75403]: INFO cinder.rpc [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 23 00:04:03 devstack cinder-volume[75403]: INFO cinder.rpc [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 23 00:04:03 devstack cinder-volume[75403]: WARNING stevedore.named [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:04:03 devstack cinder-volume[75403]: WARNING castellan.key_manager [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:04:03 devstack cinder-volume[75403]: INFO cinder.volume.manager [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_db.sqlalchemy.engines [None req-a9abecf3-43de-473a-bd94-58988086932b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75403) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:04:03 devstack cinder-volume[75403]: INFO oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Starting 1 workers Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Started child 75567 {{(pid=75403) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Full set of CONF: {{(pid=75403) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] ******************************************************************************** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Configuration options gathered from: {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] ================================================================================ {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:04:03 devstack cinder-volume[75567]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] allow_availability_zone_fallback = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] allow_compression_on_image_upload = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] allowed_direct_url_schemes = [] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] api_rate_limit = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] auth_strategy = keystone {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] az_cache_duration = 3600 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_availability_zone = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_host = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_name = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_stats_polling_interval = 60 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backup_api_class = cinder.backup.api.API {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backup_name_template = backup-%s {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backup_use_same_host = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backup_use_temp_snapshot = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] chap_password = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] chap_username = {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cinder_internal_tenant_project_id = fa4bcbd582f149ceb8fb2c3501dc3926 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cinder_internal_tenant_user_id = e82e0ee9d1034d4d88e7e9d2b2d0131e {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cloned_volume_same_az = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cluster = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] compression_format = gzip {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] compute_api_class = cinder.compute.nova.API {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] config_dir = [] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] config_source = [] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] control_exchange = openstack {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] debug = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] default_availability_zone = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] default_group_type = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] default_volume_type = lvmdriver-1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] deployment_max_gigabytes = -1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] disk_geometry = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] driver_client_cert = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] driver_client_cert_key = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] driver_data_namespace = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] driver_ssl_cert_path = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] driver_ssl_cert_verify = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] driver_use_ssl = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] enable_force_upload = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] enable_new_services = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] enable_unsupported_driver = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] enabled_backends = ['lvmdriver-1'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] enforce_multipath_for_image_xfer = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] filter_function = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance_api_insecure = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance_api_servers = ['http://192.168.122.85/image'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance_api_ssl_compression = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance_ca_certificates_file = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance_catalog_info = image:glance:publicURL {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance_certfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance_keyfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance_num_retries = 3 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance_request_timeout = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] goodness_function = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] graceful_shutdown_timeout = 5 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] group_api_class = cinder.group.api.API {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] host = devstack {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] image_compress_on_upload = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] image_conversion_address_space_limit = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] image_conversion_cpu_limit = 60 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] image_conversion_disable = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] image_introspection_address_space_limit = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] image_introspection_cpu_limit = 60 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] image_upload_use_cinder_backend = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75567]: INFO cinder.volume.manager [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] image_upload_use_internal_tenant = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] image_volume_cache_enabled = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] image_volume_cache_max_count = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] image_volume_cache_max_size_gb = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] init_host_max_objects_retrieval = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] instance_format = [instance: %(uuid)s] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] iscsi_target_flags = {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] iscsi_write_cache = on {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] iser_helper = tgtadm {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] iser_ip_address = 192.168.122.85 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] iser_port = 3260 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] log_color = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] log_config_append = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] log_dir = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] log_file = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] log_options = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] log_rotate_interval = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] log_rotate_interval_type = days {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] log_rotation_type = none {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] max_age = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] max_logfile_count = 30 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] max_logfile_size_mb = 200 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] max_over_subscription_ratio = 20.0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] message_reap_interval = 86400 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] message_ttl = 2592000 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] migration_create_volume_timeout_secs = 300 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] monkey_patch = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] monkey_patch_modules = [] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] my_ip = 192.168.122.85 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] no_snapshot_gb_quota = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] num_iser_scan_tries = 3 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] num_shell_tries = 3 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] num_volume_device_scan_tries = 3 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] nvmeof_conn_info_version = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] nvmet_ns_id = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] nvmet_port_id = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] osapi_max_limit = 1000 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] osapi_volume_ext_list = [] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] osapi_volume_listen = 0.0.0.0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] osapi_volume_listen_port = 8776 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] osapi_volume_use_ssl = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] osapi_volume_workers = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] per_volume_size_limit = -1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] periodic_fuzzy_delay = 60 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] periodic_interval = 60 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] project_id_regex = [0-9a-f\-]+ {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] public_endpoint = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] publish_errors = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] quota_backup_gigabytes = 1000 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] quota_backups = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] quota_gigabytes = 1000 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] quota_groups = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] quota_snapshots = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] quota_volumes = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] rate_limit_burst = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] rate_limit_except_level = CRITICAL {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] rate_limit_interval = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] reinit_driver_count = 3 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] replication_device = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] report_discard_supported = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] report_interval = 120 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] reservation_clean_interval = 86400 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] reservation_expire = 86400 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] reserved_image_namespaces = [] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] reserved_percentage = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] rpc_response_timeout = 120 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] run_external_periodic_tasks = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] scst_target_driver = iscsi {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] scst_target_iqn_name = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_down_time = 720 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] shell_completion = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] snapshot_name_template = snapshot-%s {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] snapshot_same_host = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] split_loggers = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] state_path = /opt/stack/data/cinder {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] storage_availability_zone = nova {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] storage_protocol = iSCSI {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] syslog_log_facility = LOG_USER {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] target_helper = lioadm {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] target_ip_address = 192.168.122.85 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] target_port = 3260 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] target_protocol = iscsi {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] target_secondary_ip_addresses = [] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] trace_flags = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] transfer_api_class = cinder.transfer.api.API {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] transport_url = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] until_refresh = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] use_chap_auth = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] use_default_quota_class = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] use_journal = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] use_json = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] use_multipath_for_image_xfer = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] use_stderr = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] use_syslog = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] verify_glance_signatures = enabled {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volume_api_class = cinder.volume.api.API {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volume_backend_name = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volume_clear = zero {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volume_clear_ionice = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volume_clear_size = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volume_copy_bps_limit = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volume_dd_blocksize = 1M {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volume_name_template = volume-%s {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volume_service_inithost_offload = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volume_usage_audit_period = month {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] zoning_mode = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_concurrency.disable_process_locking = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.auth_section = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.auth_type = password {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.auth_version = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.cache = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.certfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.include_service_catalog = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.insecure = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.interface = public {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.keyfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_password = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcache_username = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.region_name = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.service_type = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.85/identity {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.backend = dogpile.cache.null {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.backend_argument = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.backend_expiration_time = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.config_prefix = cache.oslo {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.debug_cache_backend = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.enable_retry_client = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.enable_socket_keepalive = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.enabled = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.expiration_time = 600 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.hashclient_retry_attempts = 2 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.memcache_dead_retry = 300 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.memcache_pool_maxsize = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.memcache_sasl_enabled = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.password = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.proxies = [] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.redis_db = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.redis_server = localhost:6379 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.retry_attempts = 2 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.retry_delay = 0.0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.socket_keepalive_count = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.socket_keepalive_idle = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.socket_keepalive_interval = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.socket_timeout = 1.0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.tls_allowed_ciphers = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.tls_cafile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.tls_certfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.tls_enabled = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.tls_keyfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cache.username = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] coordination.backend_url = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.asyncio_connection = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.asyncio_slave_connection = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.backend = sqlalchemy {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.connection = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.connection_debug = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.connection_parameters = {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.connection_recycle_time = 3600 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.connection_trace = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.db_inc_retry_interval = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.db_max_retries = 20 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.db_max_retry_interval = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.db_retry_interval = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.max_overflow = 50 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.max_pool_size = 5 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.max_retries = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.mysql_wsrep_sync_wait = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.pool_timeout = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.retry_interval = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.slave_connection = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.sqlite_synchronous = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.synchronous_reader = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] database.use_db_reconnect = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_tracing.insecure = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler.connection_string = messaging:// {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler.enabled = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler.es_doc_type = notification {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler.es_scroll_size = 10000 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler.es_scroll_time = 2m {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler.filter_error_trace = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler.hmac_keys = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler.sentinel_service_name = mymaster {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler.socket_timeout = 0.1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler.trace_requests = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler.trace_sqlalchemy = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler_jaeger.process_tags = {} {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler_jaeger.service_name_prefix = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] profiler_otlp.service_name_prefix = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_policy.enforce_new_defaults = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_policy.policy_default_rule = default {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_policy.policy_file = policy.yaml {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_policy.remote_timeout = 60.0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] privsep_osbrick.group = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] privsep_osbrick.helper_command = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] privsep_osbrick.user = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cinder_sys_admin.group = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cinder_sys_admin.helper_command = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] cinder_sys_admin.user = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_user.auth_section = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_user.auth_type = password {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_user.cafile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_user.certfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_user.collect_timing = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_user.insecure = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_user.keyfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_user.send_service_user_token = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_user.split_loggers = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_user.timeout = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_user.tls_ciphers = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] service_user.tls_min_version = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance.auth_section = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance.auth_type = password {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance.certfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance.collect_timing = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance.insecure = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance.keyfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance.region_name = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance.split_loggers = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance.timeout = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance.tls_ciphers = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] glance.tls_min_version = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.backend_availability_zone = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.chap_password = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.chap_username = {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.disk_geometry = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.driver_client_cert = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.driver_client_cert_key = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.driver_data_namespace = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.driver_use_ssl = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.extra_capabilities = {} {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.filter_function = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.goodness_function = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.iscsi_target_flags = {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.iscsi_write_cache = on {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.iser_helper = tgtadm {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.iser_ip_address = 192.168.122.85 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.iser_port = 3260 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.lvm_mirrors = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.lvm_share_target = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.lvm_type = auto {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.num_shell_tries = 3 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.replication_device = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.report_discard_supported = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.reserved_percentage = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack sudo[75579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 23 00:04:03 devstack sudo[75579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.target_helper = tgtadm {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.target_ip_address = 192.168.122.85 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.target_port = 3260 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.target_protocol = iscsi {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.trace_flags = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.unique_fqdn_network = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.use_chap_auth = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.volume_backend_name = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.volume_clear = zero {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.volume_clear_ionice = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.volume_clear_size = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.volume_group = cinder-volumes {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_reports.file_event_handler = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_reports.log_dir = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.backend_host = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.chap_password = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.chap_username = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.chiscsi_conf = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.disk_geometry = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.driver_client_cert = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.driver_use_ssl = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.extra_capabilities = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.filter_function = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.goodness_function = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.iser_helper = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.iser_ip_address = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.iser_port = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.lvm_conf_file = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.lvm_mirrors = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.lvm_share_target = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.lvm_type = auto {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.num_shell_tries = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.nvmet_port_id = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.replication_device = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.report_discard_supported = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.reserved_percentage = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.scst_target_driver = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.storage_protocol = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.target_helper = lioadm {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.target_ip_address = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.target_port = 3260 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.target_protocol = iscsi {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.trace_flags = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.use_chap_auth = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.volume_clear = zero {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.volume_clear_size = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] lvmdriver-1.volumes_dir = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.ssl = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.ssl_version = {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_notifications.driver = [] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_notifications.retry = -1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] key_manager.fixed_key = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.barbican_api_version = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.barbican_endpoint = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.barbican_endpoint_type = public {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.barbican_region_name = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.cafile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.certfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.collect_timing = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.insecure = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.keyfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.number_of_retries = 60 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.retry_delay = 1 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.send_service_user_token = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.split_loggers = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.timeout = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.tls_ciphers = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.tls_min_version = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.verify_ssl = True {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican.verify_ssl_path = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican_service_user.auth_section = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican_service_user.auth_type = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican_service_user.cafile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican_service_user.certfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican_service_user.collect_timing = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican_service_user.insecure = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican_service_user.keyfile = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican_service_user.split_loggers = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican_service_user.timeout = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican_service_user.tls_ciphers = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] barbican_service_user.tls_min_version = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.approle_role_id = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.approle_secret_id = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.auth_method = approle {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.auth_path = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.kv_mountpoint = secret {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.kv_path = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.kv_version = 2 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.namespace = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.root_token_id = **** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.ssl_ca_crt_file = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.timeout = 60.0 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.token_file = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.token_role = None {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.use_ssl = False {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:04:03 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] ******************************************************************************** {{(pid=75403) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:04:03 devstack sudo[75579]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:03 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:03 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:03 devstack sudo[75727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:04:03 devstack sudo[75727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:04 devstack sudo[75727]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:04 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.263s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:04 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:04:04 devstack cinder-volume[75567]: INFO cinder.brick.local_dev.lvm [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 23 00:04:04 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:04 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:04 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:04 devstack sudo[75824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:04:04 devstack sudo[75824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:04 devstack sudo[75824]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:04 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:04 devstack cinder-volume[75567]: DEBUG cinder.brick.local_dev.lvm [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75567) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 23 00:04:04 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:04 devstack sudo[75928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:04:04 devstack sudo[75928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:04 devstack sudo[75928]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:04 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.507s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:04 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:05 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:05 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:05 devstack sudo[76147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:04:05 devstack sudo[76147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:05 devstack sudo[76147]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:05 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:05 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:05 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:05 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:05 devstack sudo[76173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 23 00:04:05 devstack sudo[76173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:05 devstack sudo[76173]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:05 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.380s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:05 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:05 devstack sudo[76256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:04:05 devstack sudo[76256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:05 devstack sudo[76256]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:05 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:05 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:05 devstack sudo[76259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:04:05 devstack sudo[76259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:06 devstack sudo[76259]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:06 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:06 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:06 devstack sudo[76316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:04:06 devstack sudo[76316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:06 devstack sudo[76316]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:06 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:06 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:06 devstack sudo[76351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:04:06 devstack sudo[76351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:06 devstack sudo[76351]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:06 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:06 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:06 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:06 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:06 devstack sudo[76355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:04:06 devstack sudo[76355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:07 devstack sudo[76355]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:07 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:07 devstack cinder-volume[75567]: INFO cinder.volume.drivers.lvm [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 23 00:04:07 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:07 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:07 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:07 devstack sudo[76365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:04:07 devstack sudo[76365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:07 devstack sudo[76365]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:07 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:07 devstack cinder-volume[75567]: DEBUG cinder.volume.drivers.lvm [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Updating volume stats {{(pid=75567) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:04:07 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:07 devstack sudo[76368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:04:07 devstack sudo[76368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:07 devstack sudo[76368]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:07 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:07 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:07 devstack sudo[76371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:04:07 devstack sudo[76371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:07 devstack sudo[76371]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:07 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:07 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:07 devstack sudo[76374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:04:07 devstack sudo[76374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:08 devstack sudo[76374]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:08 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:08 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:08 devstack sudo[76377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:04:08 devstack sudo[76377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:08 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:08 devstack cinder-volume[75567]: INFO cinder.volume.driver [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:04:08 devstack cinder-volume[75567]: DEBUG cinder.volume.driver [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75567) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:04:08 devstack sudo[76377]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:08 devstack cinder-volume[75567]: DEBUG oslo_db.sqlalchemy.engines [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75567) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:04:08 devstack cinder-volume[75567]: DEBUG dbcounter [-] [75567] Writer thread running {{(pid=75567) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:04:08 devstack cinder-volume[75567]: DEBUG cinder.db.api [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Building query based on filter {{(pid=75567) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4045}} Sep 23 00:04:08 devstack cinder-volume[75567]: DEBUG cinder.image.image_utils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75567) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:04:08 devstack cinder-volume[75567]: INFO cinder.keymgr.migration [None req-22a67ad4-c643-4b15-a6ba-8a38a55b7448 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:04:08 devstack cinder-volume[75567]: DEBUG cinder.volume.drivers.lvm [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Updating volume stats {{(pid=75567) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:04:08 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:08 devstack sudo[76383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:04:08 devstack sudo[76383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:08 devstack sudo[76383]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:08 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:08 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:08 devstack sudo[76386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:04:08 devstack sudo[76386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:09 devstack sudo[76386]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:09 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:09 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:09 devstack sudo[76389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:04:09 devstack sudo[76389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:09 devstack sudo[76389]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:09 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:09 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:09 devstack sudo[76392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:04:09 devstack sudo[76392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:09 devstack sudo[76392]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:09 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:09 devstack cinder-volume[75567]: DEBUG cinder.manager [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Notifying Schedulers of capabilities ... {{(pid=75567) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:04:09 devstack cinder-volume[75567]: INFO cinder.volume.manager [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Driver initialization completed successfully. Sep 23 00:04:09 devstack cinder-volume[75567]: INFO cinder.manager [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Initiating service 2 cleanup Sep 23 00:04:09 devstack cinder-volume[75567]: INFO cinder.manager [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Service 2 cleanup completed. Sep 23 00:04:09 devstack cinder-volume[75567]: DEBUG cinder.service [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Creating RPC server for service cinder-volume {{(pid=75567) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:04:09 devstack cinder-volume[75567]: DEBUG cinder.service [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75567) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:04:09 devstack cinder-volume[75567]: INFO cinder.volume.manager [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 23 00:04:09 devstack cinder-volume[75567]: DEBUG cinder.volume.drivers.lvm [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Updating volume stats {{(pid=75567) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:04:09 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:09 devstack sudo[76403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:04:09 devstack sudo[76403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:10 devstack sudo[76403]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:10 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:10 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:10 devstack sudo[76406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:04:10 devstack sudo[76406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:10 devstack sudo[76406]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:10 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:10 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:10 devstack sudo[76412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:04:10 devstack sudo[76412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:10 devstack sudo[76412]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:10 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:10 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:04:10 devstack sudo[76415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:04:10 devstack sudo[76415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:04:10 devstack sudo[76415]: pam_unix(sudo:session): session closed for user root Sep 23 00:04:10 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:04:10 devstack cinder-volume[75567]: INFO cinder.volume.manager [None req-31237789-4ce1-4ff4-a8ae-f264ba241074 None None] Driver post RPC initialization completed successfully. Sep 23 00:04:13 devstack cinder-volume[75403]: DEBUG dbcounter [-] [75403] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75403) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:04:19 devstack cinder-volume[75567]: DEBUG dbcounter [-] [75567] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75567) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:04:20 devstack cinder-volume[75567]: DEBUG dbcounter [-] [75567] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=75567) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:04:32 devstack cinder-volume[75567]: DEBUG oslo_service.periodic_task [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running periodic task VolumeManager._thread_info {{(pid=75567) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:04:32 devstack cinder-volume[75567]: DEBUG cinder.volume.manager [None req-902c39e7-6628-45e3-a391-b796354daaed None None] thread count: 6 {{(pid=75567) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:04:32 devstack cinder-volume[75567]: DEBUG cinder.volume.manager [None req-902c39e7-6628-45e3-a391-b796354daaed None None] thread info: [<_MainThread(MainThread, started 124495042183296)>, , , , , ] {{(pid=75567) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:05:32 devstack cinder-volume[75567]: DEBUG oslo_service.periodic_task [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75567) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:05:32 devstack cinder-volume[75567]: DEBUG cinder.volume.drivers.lvm [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Updating volume stats {{(pid=75567) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:32 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:33 devstack sudo[79041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:33 devstack sudo[79041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:33 devstack sudo[79041]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:33 devstack sudo[79044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:33 devstack sudo[79044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:33 devstack sudo[79044]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:33 devstack sudo[79047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:33 devstack sudo[79047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:33 devstack sudo[79047]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:33 devstack sudo[79058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:33 devstack sudo[79058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:34 devstack sudo[79058]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:34 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:34 devstack cinder-volume[75567]: DEBUG cinder.manager [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Notifying Schedulers of capabilities ... {{(pid=75567) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:05:34 devstack cinder-volume[75567]: DEBUG oslo_service.periodic_task [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running periodic task VolumeManager._thread_info {{(pid=75567) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:05:34 devstack cinder-volume[75567]: DEBUG cinder.volume.manager [None req-902c39e7-6628-45e3-a391-b796354daaed None None] thread count: 6 {{(pid=75567) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:05:34 devstack cinder-volume[75567]: DEBUG cinder.volume.manager [None req-902c39e7-6628-45e3-a391-b796354daaed None None] thread info: [<_MainThread(MainThread, started 124495042183296)>, , , , , ] {{(pid=75567) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:06:20 devstack cinder-volume[75567]: DEBUG dbcounter [-] [75567] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75567) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:06:32 devstack cinder-volume[75567]: DEBUG oslo_service.periodic_task [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75567) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:06:32 devstack cinder-volume[75567]: DEBUG cinder.volume.drivers.lvm [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Updating volume stats {{(pid=75567) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:06:32 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:33 devstack sudo[82035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:06:33 devstack sudo[82035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:33 devstack sudo[82035]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:33 devstack sudo[82038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:06:33 devstack sudo[82038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:33 devstack sudo[82038]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:33 devstack sudo[82041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:06:33 devstack sudo[82041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:33 devstack sudo[82041]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:06:33 devstack sudo[82044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:06:33 devstack sudo[82044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:34 devstack sudo[82044]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:34 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:34 devstack cinder-volume[75567]: DEBUG cinder.manager [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Notifying Schedulers of capabilities ... {{(pid=75567) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:07:32 devstack cinder-volume[75567]: DEBUG oslo_service.periodic_task [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75567) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:07:32 devstack cinder-volume[75567]: DEBUG cinder.volume.drivers.lvm [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Updating volume stats {{(pid=75567) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:07:32 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:33 devstack sudo[84244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:07:33 devstack sudo[84244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:33 devstack sudo[84244]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:33 devstack sudo[84248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:07:33 devstack sudo[84248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:33 devstack sudo[84248]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:33 devstack sudo[84251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:07:33 devstack sudo[84251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:33 devstack sudo[84251]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:33 devstack sudo[84265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:07:33 devstack sudo[84265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:34 devstack sudo[84265]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:34 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:34 devstack cinder-volume[75567]: DEBUG cinder.manager [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Notifying Schedulers of capabilities ... {{(pid=75567) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:07:34 devstack cinder-volume[75567]: DEBUG oslo_service.periodic_task [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running periodic task VolumeManager._thread_info {{(pid=75567) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:07:34 devstack cinder-volume[75567]: DEBUG cinder.volume.manager [None req-902c39e7-6628-45e3-a391-b796354daaed None None] thread count: 6 {{(pid=75567) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:07:34 devstack cinder-volume[75567]: DEBUG cinder.volume.manager [None req-902c39e7-6628-45e3-a391-b796354daaed None None] thread info: [<_MainThread(MainThread, started 124495042183296)>, , , , , ] {{(pid=75567) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:08:20 devstack cinder-volume[75567]: DEBUG dbcounter [-] [75567] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75567) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:08:32 devstack cinder-volume[75567]: DEBUG oslo_service.periodic_task [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75567) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:08:32 devstack cinder-volume[75567]: DEBUG cinder.volume.drivers.lvm [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Updating volume stats {{(pid=75567) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:08:32 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:33 devstack sudo[85380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:08:33 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:33 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:33 devstack sudo[85406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:08:33 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:33 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:33 devstack sudo[85409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:08:33 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:33 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:33 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:33 devstack sudo[85430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:08:33 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:34 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:34 devstack cinder-volume[75567]: DEBUG oslo_concurrency.processutils [None req-902c39e7-6628-45e3-a391-b796354daaed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75567) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:34 devstack cinder-volume[75567]: DEBUG cinder.manager [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Notifying Schedulers of capabilities ... {{(pid=75567) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:08:34 devstack cinder-volume[75567]: DEBUG oslo_service.periodic_task [None req-902c39e7-6628-45e3-a391-b796354daaed None None] Running periodic task VolumeManager._thread_info {{(pid=75567) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:08:34 devstack cinder-volume[75567]: DEBUG cinder.volume.manager [None req-902c39e7-6628-45e3-a391-b796354daaed None None] thread count: 6 {{(pid=75567) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:08:34 devstack cinder-volume[75567]: DEBUG cinder.volume.manager [None req-902c39e7-6628-45e3-a391-b796354daaed None None] thread info: [<_MainThread(MainThread, started 124495042183296)>, , , , , ] {{(pid=75567) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:08:36 devstack cinder-volume[75403]: INFO oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Caught SIGTERM, stopping children Sep 23 00:08:36 devstack cinder-volume[75403]: DEBUG oslo_concurrency.lockutils [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Acquiring lock "singleton_lock" {{(pid=75403) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:08:36 devstack cinder-volume[75403]: DEBUG oslo_concurrency.lockutils [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Acquired lock "singleton_lock" {{(pid=75403) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:08:36 devstack cinder-volume[75403]: DEBUG oslo_concurrency.lockutils [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Releasing lock "singleton_lock" {{(pid=75403) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:08:36 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Stop services. {{(pid=75403) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 00:08:36 devstack cinder-volume[75403]: DEBUG oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Killing children. {{(pid=75403) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 00:08:36 devstack cinder-volume[75403]: INFO oslo_service.backend._eventlet.service [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Waiting on 1 children to exit Sep 23 00:08:41 devstack cinder-volume[75567]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 23 00:08:41 devstack cinder-volume[85566]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:08:41 devstack cinder-volume[85566]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:08:41 devstack cinder-volume[85566]: we strongly recommend against using it for new projects. Sep 23 00:08:41 devstack cinder-volume[85566]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:08:41 devstack cinder-volume[85566]: framework. For more detail see Sep 23 00:08:41 devstack cinder-volume[85566]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:08:41 devstack cinder-volume[85566]: import eventlet # noqa Sep 23 00:08:43 devstack cinder-volume[85566]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85566) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:08:43 devstack cinder-volume[85566]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85566) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:08:43 devstack cinder-volume[85566]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85566) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:08:44 devstack cinder-volume[85566]: INFO dbcounter [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Registered counter for database cinder Sep 23 00:08:44 devstack cinder-volume[85566]: DEBUG oslo_db.sqlalchemy.engines [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85566) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:08:44 devstack cinder-volume[85566]: DEBUG dbcounter [-] [85566] Writer thread running {{(pid=85566) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:08:44 devstack cinder-volume[85566]: INFO cinder.rpc [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:08:44 devstack cinder-volume[85566]: INFO cinder.rpc [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:08:44 devstack cinder-volume[75567]: DEBUG oslo_concurrency.lockutils [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Acquiring lock "singleton_lock" {{(pid=75567) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:08:44 devstack cinder-volume[75567]: DEBUG oslo_concurrency.lockutils [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Acquired lock "singleton_lock" {{(pid=75567) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:08:44 devstack cinder-volume[75567]: DEBUG oslo_concurrency.lockutils [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Releasing lock "singleton_lock" {{(pid=75567) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:08:44 devstack cinder-volume[75567]: WARNING amqp [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:08:44 devstack cinder-volume[85566]: DEBUG oslo_db.sqlalchemy.engines [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85566) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:08:44 devstack cinder-volume[75567]: WARNING amqp [None req-a9abecf3-43de-473a-bd94-58988086932b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:08:44 devstack cinder-volume[85566]: INFO cinder.volume.manager [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Determined volume DB was empty at startup. Sep 23 00:08:44 devstack cinder-volume[85566]: DEBUG cinder.volume.manager [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85566) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:08:44 devstack cinder-volume[85566]: INFO cinder.volume.manager [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 00:08:44 devstack cinder-volume[85566]: WARNING stevedore.named [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:08:44 devstack cinder-volume[85566]: WARNING castellan.key_manager [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:08:44 devstack cinder-volume[85566]: WARNING cinder.keymgr.conf_key_mgr [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:08:45 devstack cinder-volume[85566]: INFO cinder.volume.manager [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_db.sqlalchemy.engines [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85566) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:08:45 devstack cinder-volume[85566]: INFO oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Starting 1 workers Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Started child 85817 {{(pid=85566) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Full set of CONF: {{(pid=85566) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] ******************************************************************************** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Configuration options gathered from: {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] ================================================================================ {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] allow_availability_zone_fallback = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] allow_compression_on_image_upload = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85817]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] allowed_direct_url_schemes = [] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] api_rate_limit = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] auth_strategy = keystone {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_availability_zone = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_host = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_name = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_stats_polling_interval = 60 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backup_api_class = cinder.backup.api.API {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backup_name_template = backup-%s {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backup_use_same_host = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backup_use_temp_snapshot = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] chap_password = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] chap_username = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cinder_internal_tenant_project_id = fa4bcbd582f149ceb8fb2c3501dc3926 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cinder_internal_tenant_user_id = e82e0ee9d1034d4d88e7e9d2b2d0131e {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cluster = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] compression_format = gzip {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] compute_api_class = cinder.compute.nova.API {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] config_dir = [] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] config_source = [] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] control_exchange = openstack {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] debug = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] default_availability_zone = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] default_group_type = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] default_volume_type = QuobyteHD {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] deployment_max_gigabytes = -1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] disk_geometry = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] driver_client_cert = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] driver_client_cert_key = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] driver_data_namespace = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] driver_ssl_cert_path = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] driver_ssl_cert_verify = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] driver_use_ssl = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] enable_new_services = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] enable_unsupported_driver = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] enabled_backends = ['QuobyteHD'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] enforce_multipath_for_image_xfer = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] filter_function = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance_api_insecure = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance_api_servers = ['http://192.168.122.85/image'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance_api_ssl_compression = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance_ca_certificates_file = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance_catalog_info = image:glance:publicURL {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance_certfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance_keyfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance_num_retries = 3 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance_request_timeout = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] goodness_function = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] graceful_shutdown_timeout = 5 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] group_api_class = cinder.group.api.API {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] host = devstack {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] image_compress_on_upload = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] image_conversion_address_space_limit = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] image_conversion_cpu_limit = 60 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] image_conversion_disable = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] image_introspection_address_space_limit = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] image_introspection_cpu_limit = 60 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] image_upload_use_cinder_backend = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] image_upload_use_internal_tenant = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] image_volume_cache_enabled = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] image_volume_cache_max_count = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] image_volume_cache_max_size_gb = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] init_host_max_objects_retrieval = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] instance_format = [instance: %(uuid)s] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] iscsi_target_flags = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] iscsi_write_cache = on {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] iser_helper = tgtadm {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85817]: INFO cinder.volume.manager [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 00:08:45 devstack cinder-volume[85817]: DEBUG cinder.volume.drivers.remotefs [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85817) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] iser_ip_address = 192.168.122.85 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] iser_port = 3260 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] log_color = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] log_config_append = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] log_dir = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] log_file = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] log_options = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] log_rotate_interval = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] log_rotate_interval_type = days {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] log_rotation_type = none {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] max_age = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] max_logfile_count = 30 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] max_logfile_size_mb = 200 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] max_over_subscription_ratio = 20.0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] message_reap_interval = 86400 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] message_ttl = 2592000 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] migration_create_volume_timeout_secs = 300 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] monkey_patch = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] monkey_patch_modules = [] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] my_ip = 192.168.122.85 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] no_snapshot_gb_quota = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] num_iser_scan_tries = 3 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] num_shell_tries = 3 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] num_volume_device_scan_tries = 3 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] nvmeof_conn_info_version = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] nvmet_ns_id = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] nvmet_port_id = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] osapi_max_limit = 1000 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] osapi_volume_ext_list = [] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] osapi_volume_listen_port = 8776 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] osapi_volume_use_ssl = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] osapi_volume_workers = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] per_volume_size_limit = -1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] periodic_fuzzy_delay = 60 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] periodic_interval = 60 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] public_endpoint = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] publish_errors = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] quota_backup_gigabytes = 1000 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] quota_backups = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] quota_gigabytes = 1000 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] quota_groups = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] quota_snapshots = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] quota_volumes = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] rate_limit_burst = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] rate_limit_except_level = CRITICAL {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] rate_limit_interval = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] reinit_driver_count = 3 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] replication_device = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] report_discard_supported = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] report_interval = 120 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] reservation_clean_interval = 86400 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] reservation_expire = 86400 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] reserved_image_namespaces = [] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] reserved_percentage = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] rpc_response_timeout = 120 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] run_external_periodic_tasks = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] scst_target_driver = iscsi {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] scst_target_iqn_name = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_down_time = 720 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] shell_completion = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] snapshot_name_template = snapshot-%s {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] split_loggers = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] state_path = /opt/stack/data/cinder {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] storage_availability_zone = nova {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] storage_protocol = iSCSI {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] syslog_log_facility = LOG_USER {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] target_helper = lioadm {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] target_ip_address = 192.168.122.85 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] target_port = 3260 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] target_protocol = iscsi {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] target_secondary_ip_addresses = [] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] trace_flags = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] transport_url = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] until_refresh = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] use_chap_auth = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] use_default_quota_class = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] use_journal = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] use_json = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] use_multipath_for_image_xfer = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] use_stderr = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] use_syslog = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] verify_glance_signatures = enabled {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volume_api_class = cinder.volume.api.API {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volume_backend_name = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volume_clear = zero {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volume_clear_ionice = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volume_clear_size = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volume_copy_bps_limit = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volume_dd_blocksize = 1M {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volume_name_template = volume-%s {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volume_service_inithost_offload = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volume_usage_audit_period = month {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] zoning_mode = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_concurrency.disable_process_locking = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.auth_section = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.auth_type = password {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.auth_version = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.cache = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.certfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.include_service_catalog = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.insecure = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.interface = public {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.keyfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_password = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcache_username = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.region_name = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.service_type = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.85/identity {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.backend = dogpile.cache.null {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.backend_argument = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.backend_expiration_time = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.config_prefix = cache.oslo {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.debug_cache_backend = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.enable_retry_client = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.enable_socket_keepalive = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.enabled = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.expiration_time = 600 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.hashclient_retry_attempts = 2 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.memcache_dead_retry = 300 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85817]: DEBUG cinder.volume.drivers.quobyte [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85817) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 00:08:45 devstack cinder-volume[85817]: WARNING cinder.volume.drivers.quobyte [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 00:08:45 devstack cinder-volume[85817]: WARNING cinder.volume.drivers.quobyte [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 00:08:45 devstack cinder-volume[85817]: DEBUG oslo_concurrency.processutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Running cmd (subprocess): mount.quobyte {{(pid=85817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.memcache_pool_maxsize = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.memcache_sasl_enabled = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.password = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.proxies = [] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.redis_db = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.redis_server = localhost:6379 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.retry_attempts = 2 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.retry_delay = 0.0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.socket_keepalive_count = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.socket_keepalive_idle = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.socket_keepalive_interval = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.socket_timeout = 1.0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.tls_allowed_ciphers = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.tls_cafile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.tls_certfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.tls_enabled = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.tls_keyfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cache.username = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] coordination.backend_url = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.asyncio_connection = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.asyncio_slave_connection = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.backend = sqlalchemy {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.connection = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.connection_debug = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.connection_parameters = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.connection_recycle_time = 3600 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.connection_trace = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.db_inc_retry_interval = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.db_max_retries = 20 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.db_max_retry_interval = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.db_retry_interval = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.max_overflow = 50 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.max_pool_size = 5 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.max_retries = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.mysql_wsrep_sync_wait = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.pool_timeout = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.retry_interval = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.slave_connection = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.sqlite_synchronous = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.synchronous_reader = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] database.use_db_reconnect = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_tracing.insecure = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler.connection_string = messaging:// {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler.enabled = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler.es_doc_type = notification {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler.es_scroll_size = 10000 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler.es_scroll_time = 2m {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler.filter_error_trace = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler.hmac_keys = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler.sentinel_service_name = mymaster {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler.socket_timeout = 0.1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler.trace_requests = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler.trace_sqlalchemy = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler_jaeger.process_tags = {} {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler_jaeger.service_name_prefix = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] profiler_otlp.service_name_prefix = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_policy.enforce_new_defaults = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_policy.policy_default_rule = default {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_policy.policy_file = policy.yaml {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] privsep_osbrick.group = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] privsep_osbrick.helper_command = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] privsep_osbrick.user = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cinder_sys_admin.group = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cinder_sys_admin.helper_command = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] cinder_sys_admin.user = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_user.auth_section = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_user.auth_type = password {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_user.cafile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_user.certfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_user.collect_timing = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_user.insecure = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_user.keyfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_user.send_service_user_token = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_user.split_loggers = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_user.timeout = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_user.tls_ciphers = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] service_user.tls_min_version = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance.auth_section = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance.auth_type = password {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance.certfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance.collect_timing = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance.insecure = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance.keyfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance.region_name = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance.split_loggers = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance.timeout = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance.tls_ciphers = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] glance.tls_min_version = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.backend_availability_zone = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.chap_password = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.chap_username = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.disk_geometry = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.driver_client_cert = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.driver_client_cert_key = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.driver_data_namespace = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.driver_use_ssl = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.extra_capabilities = {} {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.filter_function = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.goodness_function = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.iscsi_target_flags = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.iscsi_write_cache = on {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.iser_helper = tgtadm {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.iser_ip_address = 192.168.122.85 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.iser_port = 3260 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nas_host = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nas_login = admin {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nas_mount_options = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nas_password = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nas_private_key = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nas_share_path = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.num_shell_tries = 3 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.quobyte_volume_url = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.replication_device = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.report_discard_supported = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.reserved_percentage = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.target_helper = tgtadm {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.target_ip_address = 192.168.122.85 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.target_port = 3260 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.target_protocol = iscsi {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.trace_flags = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.unique_fqdn_network = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.use_chap_auth = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.volume_backend_name = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.volume_clear = zero {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.volume_clear_ionice = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.volume_clear_size = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_reports.file_event_handler = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_reports.log_dir = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.backend_availability_zone = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.backend_host = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.chap_password = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.chap_username = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.chiscsi_conf = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.disk_geometry = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.driver_client_cert = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.driver_data_namespace = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.driver_use_ssl = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.extra_capabilities = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.filter_function = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.goodness_function = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.iser_helper = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.iser_ip_address = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.iser_port = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.iser_target_prefix = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nas_host = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nas_login = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nas_mount_options = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nas_password = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nas_private_key = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nas_share_path = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nas_ssh_port = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.num_shell_tries = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.nvmet_port_id = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.replication_device = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.report_discard_supported = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.reserved_percentage = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.scst_target_driver = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.storage_protocol = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.target_helper = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.target_ip_address = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.target_port = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.target_prefix = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.target_protocol = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.trace_flags = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.use_chap_auth = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.volume_clear = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack quobyte-client[85826]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.volume_clear_size = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] QuobyteHD.volumes_dir = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack quobyte-client[85826]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85817]: DEBUG oslo_concurrency.processutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] CMD "mount.quobyte" returned: 1 in 0.098s {{(pid=85817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85817) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85817) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85817]: DEBUG cinder.volume.drivers.quobyte [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=85817) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85817]: INFO cinder.volume.drivers.quobyte [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 ... Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85817]: DEBUG oslo_concurrency.processutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 -c /etc/quobyte/client-cinder.cfg {{(pid=85817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.ssl = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_notifications.driver = [] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_notifications.retry = -1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] key_manager.fixed_key = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.barbican_api_version = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.barbican_endpoint = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.barbican_endpoint_type = public {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.barbican_region_name = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.cafile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.certfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.collect_timing = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.insecure = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.keyfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.number_of_retries = 60 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.retry_delay = 1 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.send_service_user_token = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.split_loggers = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.timeout = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.tls_ciphers = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.tls_min_version = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.verify_ssl = True {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican.verify_ssl_path = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican_service_user.auth_section = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican_service_user.auth_type = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican_service_user.cafile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican_service_user.certfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican_service_user.collect_timing = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican_service_user.insecure = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican_service_user.keyfile = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican_service_user.split_loggers = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican_service_user.timeout = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican_service_user.tls_ciphers = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] barbican_service_user.tls_min_version = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.approle_role_id = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.approle_secret_id = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.auth_method = approle {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.auth_path = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.kv_mountpoint = secret {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.kv_path = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.kv_version = 2 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.namespace = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.root_token_id = **** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.ssl_ca_crt_file = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.timeout = 60.0 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.token_file = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.token_role = None {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.use_ssl = False {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:08:45 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] ******************************************************************************** {{(pid=85566) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:08:45 devstack sudo[85827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 -c /etc/quobyte/client-cinder.cfg Sep 23 00:08:45 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:45 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:45 devstack cinder-volume[85817]: DEBUG oslo_concurrency.processutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.424s {{(pid=85817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:45 devstack cinder-volume[85817]: INFO cinder.volume.drivers.quobyte [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 succeeded Sep 23 00:08:45 devstack cinder-volume[85817]: DEBUG cinder.volume.drivers.quobyte [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=85817) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:08:45 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.435s {{(pid=85817) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:08:45 devstack cinder-volume[85817]: DEBUG oslo_concurrency.processutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=85817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:45 devstack sudo[85926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:08:45 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:46 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG oslo_concurrency.processutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.254s {{(pid=85817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:46 devstack cinder-volume[85817]: INFO cinder.volume.driver [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG cinder.volume.driver [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85817) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG oslo_db.sqlalchemy.engines [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85817) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG dbcounter [-] [85817] Writer thread running {{(pid=85817) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG cinder.db.api [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Building query based on filter {{(pid=85817) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4045}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG cinder.image.image_utils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85817) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:08:46 devstack cinder-volume[85817]: INFO cinder.keymgr.migration [None req-284f4529-6950-4b19-8924-e69b365bda1f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85817) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85817) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG cinder.volume.drivers.quobyte [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=85817) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG cinder.volume.drivers.quobyte [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=85817) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85817) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG oslo_concurrency.processutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=85817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:46 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:08:46 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:46 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG oslo_concurrency.processutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.234s {{(pid=85817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG cinder.manager [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Notifying Schedulers of capabilities ... {{(pid=85817) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:08:46 devstack cinder-volume[85817]: INFO cinder.volume.manager [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Driver initialization completed successfully. Sep 23 00:08:46 devstack cinder-volume[85817]: INFO cinder.manager [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Initiating service 3 cleanup Sep 23 00:08:46 devstack cinder-volume[85817]: INFO cinder.manager [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Service 3 cleanup completed. Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG cinder.service [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Creating RPC server for service cinder-volume {{(pid=85817) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG cinder.service [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85817) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:08:46 devstack cinder-volume[85817]: INFO cinder.volume.manager [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85817) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85817) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG cinder.volume.drivers.quobyte [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=85817) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG cinder.volume.drivers.quobyte [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=85817) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85817) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG oslo_concurrency.processutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=85817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:46 devstack sudo[85932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:08:46 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:46 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:46 devstack cinder-volume[85817]: DEBUG oslo_concurrency.processutils [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.258s {{(pid=85817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:47 devstack cinder-volume[85817]: INFO cinder.volume.manager [None req-3ef52ee9-ee16-43a3-bee4-b75647010cfd None None] Driver post RPC initialization completed successfully. Sep 23 00:08:51 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-5b2eb951-2162-42a0-9328-539c834480a9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85817) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:08:51 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-5b2eb951-2162-42a0-9328-539c834480a9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85817) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:08:51 devstack cinder-volume[85817]: DEBUG cinder.volume.drivers.quobyte [None req-5b2eb951-2162-42a0-9328-539c834480a9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=85817) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:08:51 devstack cinder-volume[85817]: DEBUG cinder.volume.drivers.quobyte [None req-5b2eb951-2162-42a0-9328-539c834480a9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=85817) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:08:51 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-5b2eb951-2162-42a0-9328-539c834480a9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85817) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:08:51 devstack cinder-volume[85817]: DEBUG oslo_concurrency.processutils [None req-5b2eb951-2162-42a0-9328-539c834480a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=85817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:51 devstack sudo[86051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:08:51 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:51 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:51 devstack cinder-volume[85817]: DEBUG oslo_concurrency.processutils [None req-5b2eb951-2162-42a0-9328-539c834480a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.250s {{(pid=85817) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:51 devstack cinder-volume[85817]: DEBUG cinder.manager [None req-5b2eb951-2162-42a0-9328-539c834480a9 None None] Notifying Schedulers of capabilities ... {{(pid=85817) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:08:54 devstack cinder-volume[85566]: INFO oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Caught SIGTERM, stopping children Sep 23 00:08:54 devstack cinder-volume[85566]: DEBUG oslo_concurrency.lockutils [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Acquiring lock "singleton_lock" {{(pid=85566) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:08:54 devstack cinder-volume[85566]: DEBUG oslo_concurrency.lockutils [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Acquired lock "singleton_lock" {{(pid=85566) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:08:54 devstack cinder-volume[85566]: DEBUG oslo_concurrency.lockutils [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Releasing lock "singleton_lock" {{(pid=85566) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:08:54 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Stop services. {{(pid=85566) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 00:08:54 devstack cinder-volume[85566]: DEBUG oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Killing children. {{(pid=85566) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 00:08:54 devstack cinder-volume[85566]: INFO oslo_service.backend._eventlet.service [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Waiting on 1 children to exit Sep 23 00:08:56 devstack cinder-volume[85817]: DEBUG dbcounter [-] [85817] Writing DB stats cinder:SELECT=4 {{(pid=85817) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:08:56 devstack cinder-volume[85817]: DEBUG dbcounter [-] [85817] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85817) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:08:59 devstack cinder-volume[85817]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 23 00:08:59 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Acquiring lock "singleton_lock" {{(pid=85817) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:08:59 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Acquired lock "singleton_lock" {{(pid=85817) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:08:59 devstack cinder-volume[85817]: DEBUG oslo_concurrency.lockutils [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Releasing lock "singleton_lock" {{(pid=85817) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:08:59 devstack cinder-volume[85817]: WARNING amqp [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:08:59 devstack cinder-volume[85817]: WARNING amqp [None req-6fc12e26-9231-4364-bf2d-da4213249ba6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:09:00 devstack cinder-volume[86196]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:09:00 devstack cinder-volume[86196]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:09:00 devstack cinder-volume[86196]: we strongly recommend against using it for new projects. Sep 23 00:09:00 devstack cinder-volume[86196]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:09:00 devstack cinder-volume[86196]: framework. For more detail see Sep 23 00:09:00 devstack cinder-volume[86196]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:09:00 devstack cinder-volume[86196]: import eventlet # noqa Sep 23 00:09:03 devstack cinder-volume[86196]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86196) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:09:03 devstack cinder-volume[86196]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86196) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:09:03 devstack cinder-volume[86196]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86196) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:09:03 devstack cinder-volume[86196]: INFO dbcounter [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] Registered counter for database cinder Sep 23 00:09:03 devstack cinder-volume[86196]: DEBUG oslo_db.sqlalchemy.engines [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86196) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG dbcounter [-] [86196] Writer thread running {{(pid=86196) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:09:04 devstack cinder-volume[86196]: INFO cinder.rpc [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:09:04 devstack cinder-volume[86196]: INFO cinder.rpc [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_db.sqlalchemy.engines [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86196) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:09:04 devstack cinder-volume[86196]: INFO cinder.volume.manager [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] Determined volume DB was empty at startup. Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG cinder.volume.manager [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86196) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:09:04 devstack cinder-volume[86196]: WARNING stevedore.named [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:09:04 devstack cinder-volume[86196]: WARNING castellan.key_manager [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:09:04 devstack cinder-volume[86196]: WARNING cinder.keymgr.conf_key_mgr [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:09:04 devstack cinder-volume[86196]: INFO cinder.volume.manager [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_db.sqlalchemy.engines [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86196) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:09:04 devstack cinder-volume[86196]: INFO oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] Starting 1 workers Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] Started child 86481 {{(pid=86196) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] Full set of CONF: {{(pid=86196) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] ******************************************************************************** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] Configuration options gathered from: {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] ================================================================================ {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] allow_availability_zone_fallback = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] allow_compression_on_image_upload = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] allowed_direct_url_schemes = [] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] api_rate_limit = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] auth_strategy = keystone {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_availability_zone = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86481]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_host = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_name = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_stats_polling_interval = 60 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backup_api_class = cinder.backup.api.API {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backup_name_template = backup-%s {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backup_use_same_host = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backup_use_temp_snapshot = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] chap_password = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] chap_username = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cinder_internal_tenant_project_id = fa4bcbd582f149ceb8fb2c3501dc3926 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cinder_internal_tenant_user_id = e82e0ee9d1034d4d88e7e9d2b2d0131e {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cluster = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] compression_format = gzip {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] compute_api_class = cinder.compute.nova.API {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] config_dir = [] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] config_source = [] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] control_exchange = openstack {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] debug = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] default_availability_zone = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] default_group_type = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] default_volume_type = QuobyteHD {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] deployment_max_gigabytes = -1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] disk_geometry = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] driver_client_cert = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] driver_client_cert_key = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] driver_data_namespace = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] driver_ssl_cert_path = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] driver_ssl_cert_verify = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] driver_use_ssl = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] enable_new_services = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] enable_unsupported_driver = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] enabled_backends = ['QuobyteHD'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] enforce_multipath_for_image_xfer = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] filter_function = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance_api_insecure = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance_api_servers = ['http://192.168.122.85/image'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance_api_ssl_compression = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance_ca_certificates_file = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance_catalog_info = image:glance:publicURL {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance_certfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance_keyfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance_num_retries = 3 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance_request_timeout = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] goodness_function = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] graceful_shutdown_timeout = 5 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] group_api_class = cinder.group.api.API {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] host = devstack {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] image_compress_on_upload = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] image_conversion_address_space_limit = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] image_conversion_cpu_limit = 60 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] image_conversion_disable = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] image_introspection_address_space_limit = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] image_introspection_cpu_limit = 60 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] image_upload_use_cinder_backend = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] image_upload_use_internal_tenant = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] image_volume_cache_enabled = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] image_volume_cache_max_count = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] image_volume_cache_max_size_gb = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] init_host_max_objects_retrieval = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] instance_format = [instance: %(uuid)s] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] iscsi_target_flags = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] iscsi_write_cache = on {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] iser_helper = tgtadm {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] iser_ip_address = 192.168.122.85 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] iser_port = 3260 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] log_color = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] log_config_append = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] log_dir = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] log_file = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] log_options = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] log_rotate_interval = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] log_rotate_interval_type = days {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] log_rotation_type = none {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] max_age = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] max_logfile_count = 30 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] max_logfile_size_mb = 200 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] max_over_subscription_ratio = 20.0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] message_reap_interval = 86400 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] message_ttl = 2592000 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86481) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] migration_create_volume_timeout_secs = 300 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] monkey_patch = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] monkey_patch_modules = [] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] my_ip = 192.168.122.85 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] no_snapshot_gb_quota = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] num_iser_scan_tries = 3 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] num_shell_tries = 3 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] num_volume_device_scan_tries = 3 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] nvmeof_conn_info_version = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] nvmet_ns_id = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] nvmet_port_id = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] osapi_max_limit = 1000 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] osapi_volume_ext_list = [] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] osapi_volume_listen_port = 8776 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] osapi_volume_use_ssl = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] osapi_volume_workers = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] per_volume_size_limit = -1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] periodic_fuzzy_delay = 60 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] periodic_interval = 60 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] public_endpoint = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] publish_errors = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] quota_backup_gigabytes = 1000 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] quota_backups = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] quota_gigabytes = 1000 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] quota_groups = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] quota_snapshots = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] quota_volumes = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] rate_limit_burst = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] rate_limit_except_level = CRITICAL {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] rate_limit_interval = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] reinit_driver_count = 3 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] replication_device = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] report_discard_supported = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] report_interval = 120 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] reservation_clean_interval = 86400 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] reservation_expire = 86400 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] reserved_image_namespaces = [] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] reserved_percentage = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] rpc_response_timeout = 120 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] run_external_periodic_tasks = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] scst_target_driver = iscsi {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] scst_target_iqn_name = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_down_time = 720 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] shell_completion = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] snapshot_name_template = snapshot-%s {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] split_loggers = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] state_path = /opt/stack/data/cinder {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] storage_availability_zone = nova {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] storage_protocol = iSCSI {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] syslog_log_facility = LOG_USER {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] target_helper = lioadm {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] target_ip_address = 192.168.122.85 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] target_port = 3260 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] target_protocol = iscsi {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] target_secondary_ip_addresses = [] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] trace_flags = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] transport_url = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] until_refresh = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] use_chap_auth = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] use_default_quota_class = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] use_journal = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] use_json = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] use_multipath_for_image_xfer = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] use_stderr = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] use_syslog = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] verify_glance_signatures = enabled {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volume_api_class = cinder.volume.api.API {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volume_backend_name = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volume_clear = zero {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volume_clear_ionice = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volume_clear_size = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volume_copy_bps_limit = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volume_dd_blocksize = 1M {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volume_name_template = volume-%s {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volume_service_inithost_offload = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volume_usage_audit_period = month {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] zoning_mode = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_concurrency.disable_process_locking = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.auth_section = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.auth_type = password {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.auth_version = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.cache = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.certfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.include_service_catalog = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.insecure = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.interface = public {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.keyfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_password = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcache_username = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.region_name = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.service_type = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.85/identity {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.backend = dogpile.cache.null {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.backend_argument = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.backend_expiration_time = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.config_prefix = cache.oslo {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.debug_cache_backend = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.enable_retry_client = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.enable_socket_keepalive = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.enabled = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.expiration_time = 600 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.hashclient_retry_attempts = 2 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.memcache_dead_retry = 300 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.memcache_pool_maxsize = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.memcache_sasl_enabled = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.password = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.proxies = [] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.redis_db = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.redis_server = localhost:6379 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.retry_attempts = 2 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.retry_delay = 0.0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86481) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 00:09:04 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.quobyte [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 00:09:04 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.quobyte [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.socket_keepalive_count = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.socket_keepalive_idle = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.socket_keepalive_interval = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.socket_timeout = 1.0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.tls_allowed_ciphers = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.tls_cafile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.tls_certfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.tls_enabled = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.tls_keyfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cache.username = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] coordination.backend_url = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.asyncio_connection = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.asyncio_slave_connection = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.backend = sqlalchemy {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.connection = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Running cmd (subprocess): mount.quobyte {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.connection_debug = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.connection_parameters = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.connection_recycle_time = 3600 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.connection_trace = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.db_inc_retry_interval = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.db_max_retries = 20 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.db_max_retry_interval = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.db_retry_interval = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.max_overflow = 50 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.max_pool_size = 5 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.max_retries = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.mysql_wsrep_sync_wait = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.pool_timeout = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.retry_interval = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.slave_connection = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.sqlite_synchronous = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.synchronous_reader = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] database.use_db_reconnect = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_tracing.insecure = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler.connection_string = messaging:// {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler.enabled = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler.es_doc_type = notification {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler.es_scroll_size = 10000 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler.es_scroll_time = 2m {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler.filter_error_trace = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler.hmac_keys = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler.sentinel_service_name = mymaster {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler.socket_timeout = 0.1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler.trace_requests = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler.trace_sqlalchemy = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler_jaeger.process_tags = {} {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler_jaeger.service_name_prefix = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] profiler_otlp.service_name_prefix = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_policy.enforce_new_defaults = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_policy.policy_default_rule = default {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_policy.policy_file = policy.yaml {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] privsep_osbrick.group = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] privsep_osbrick.helper_command = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] privsep_osbrick.user = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cinder_sys_admin.group = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cinder_sys_admin.helper_command = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] cinder_sys_admin.user = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_user.auth_section = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_user.auth_type = password {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_user.cafile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_user.certfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_user.collect_timing = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_user.insecure = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_user.keyfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_user.send_service_user_token = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_user.split_loggers = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_user.timeout = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_user.tls_ciphers = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] service_user.tls_min_version = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance.auth_section = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance.auth_type = password {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance.certfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance.collect_timing = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance.insecure = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance.keyfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance.region_name = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance.split_loggers = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance.timeout = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance.tls_ciphers = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] glance.tls_min_version = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.backend_availability_zone = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.chap_password = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack quobyte-client[86490]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 00:09:04 devstack quobyte-client[86490]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.chap_username = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.disk_geometry = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.driver_client_cert = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.driver_client_cert_key = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.driver_data_namespace = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.driver_use_ssl = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.extra_capabilities = {} {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.filter_function = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.goodness_function = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.iscsi_target_flags = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.iscsi_write_cache = on {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.iser_helper = tgtadm {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.iser_ip_address = 192.168.122.85 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.iser_port = 3260 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nas_host = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nas_login = admin {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nas_mount_options = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nas_password = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nas_private_key = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nas_share_path = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.num_shell_tries = 3 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.quobyte_volume_url = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.replication_device = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.report_discard_supported = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.reserved_percentage = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.target_helper = tgtadm {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.target_ip_address = 192.168.122.85 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.target_port = 3260 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.target_protocol = iscsi {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.trace_flags = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.unique_fqdn_network = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.use_chap_auth = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.volume_backend_name = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.volume_clear = zero {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.volume_clear_ionice = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.volume_clear_size = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_reports.file_event_handler = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_reports.log_dir = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.backend_availability_zone = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.backend_host = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.chap_password = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.chap_username = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.chiscsi_conf = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.disk_geometry = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.driver_client_cert = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.driver_data_namespace = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.driver_use_ssl = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.extra_capabilities = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.filter_function = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.goodness_function = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.iser_helper = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.iser_ip_address = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.iser_port = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.iser_target_prefix = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nas_host = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nas_login = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nas_mount_options = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nas_password = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nas_private_key = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nas_share_path = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nas_ssh_port = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.num_shell_tries = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.nvmet_port_id = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.replication_device = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.report_discard_supported = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.reserved_percentage = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.scst_target_driver = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.storage_protocol = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.target_helper = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.target_ip_address = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.target_port = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.target_prefix = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.target_protocol = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.trace_flags = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.use_chap_auth = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.volume_clear = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.volume_clear_size = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] QuobyteHD.volumes_dir = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:09:04 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.ssl = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_notifications.driver = [] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_notifications.retry = -1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] key_manager.fixed_key = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.barbican_api_version = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.barbican_endpoint = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.barbican_endpoint_type = public {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.barbican_region_name = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.cafile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.certfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.collect_timing = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.insecure = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.keyfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.number_of_retries = 60 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.retry_delay = 1 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.send_service_user_token = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.split_loggers = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.timeout = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.tls_ciphers = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.tls_min_version = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.verify_ssl = True {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican.verify_ssl_path = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican_service_user.auth_section = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican_service_user.auth_type = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican_service_user.cafile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican_service_user.certfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican_service_user.collect_timing = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican_service_user.insecure = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican_service_user.keyfile = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican_service_user.split_loggers = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican_service_user.timeout = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican_service_user.tls_ciphers = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] barbican_service_user.tls_min_version = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.approle_role_id = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.approle_secret_id = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.auth_method = approle {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.auth_path = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.kv_mountpoint = secret {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.kv_path = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.kv_version = 2 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.namespace = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.root_token_id = **** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.ssl_ca_crt_file = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.timeout = 60.0 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.token_file = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.token_role = None {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.use_ssl = False {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:09:04 devstack cinder-volume[86196]: DEBUG oslo_service.backend._eventlet.service [None req-ba7098e6-0cf1-4b8b-b27c-fb4c8695edb7 None None] ******************************************************************************** {{(pid=86196) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:09:04 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.317s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:04 devstack cinder-volume[86481]: INFO cinder.volume.driver [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG cinder.volume.driver [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86481) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:09:04 devstack cinder-volume[86481]: DEBUG oslo_db.sqlalchemy.engines [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86481) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writer thread running {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG cinder.db.api [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Building query based on filter {{(pid=86481) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4045}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86481) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:05 devstack cinder-volume[86481]: INFO cinder.keymgr.migration [None req-a30cbc90-ba6c-4977-aade-96a6e15d907c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:09:05 devstack sudo[86505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:09:05 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:05 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.263s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:09:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Driver initialization completed successfully. Sep 23 00:09:05 devstack cinder-volume[86481]: INFO cinder.manager [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Initiating service 3 cleanup Sep 23 00:09:05 devstack cinder-volume[86481]: INFO cinder.manager [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Service 3 cleanup completed. Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG cinder.service [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Creating RPC server for service cinder-volume {{(pid=86481) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG cinder.service [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86481) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:09:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:05 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:09:05 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:05 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.295s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ea7c056f-1fef-4cbe-b9e7-c025348cfb86 None None] Driver post RPC initialization completed successfully. Sep 23 00:09:14 devstack cinder-volume[86196]: DEBUG dbcounter [-] [86196] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86196) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:09:15 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:09:15 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=4 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:09:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:09:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 6 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:09:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Flow 'volume_create_manager' (6e2823b6-2bad-4c28-9fc9-5e3cb93d6d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc0993a-2cef-4ecf-93f6-083b0beb2d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc0993a-2cef-4ecf-93f6-083b0beb2d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1800420307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8612ea87-6210-4fa5-abba-e9e1be403563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='193fb60046da46a28954ee8dd65302c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:04Z,use_quota=True,user_id='73ece0a562a346cdad7cea6c4d4aa82f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846927f2-3e77-408a-a81f-130d1e40cb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846927f2-3e77-408a-a81f-130d1e40cb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac712a4-5d20-44d2-9344-50451ed99813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac712a4-5d20-44d2-9344-50451ed99813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8612ea87-6210-4fa5-abba-e9e1be403563', 'volume_name': 'volume-8612ea87-6210-4fa5-abba-e9e1be403563', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02794510-7333-4acd-b3c0-901a5e62c839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02794510-7333-4acd-b3c0-901a5e62c839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83dc8482-a030-422d-a701-23b9b8055b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:03 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Volume 8612ea87-6210-4fa5-abba-e9e1be403563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8612ea87-6210-4fa5-abba-e9e1be403563', 'volume_size': 1} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1800420307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8612ea87-6210-4fa5-abba-e9e1be403563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='193fb60046da46a28954ee8dd65302c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:04Z,use_quota=True,user_id='73ece0a562a346cdad7cea6c4d4aa82f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Creating volume 8612ea87-6210-4fa5-abba-e9e1be403563 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:03 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:10:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:04 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 1073741824 Sep 23 00:10:04 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Flow 'volume_create_manager' (03eeb70b-32ef-49ad-9802-4ada90c98b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054d7cdc-64bf-4125-80ee-bd477f4aa2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054d7cdc-64bf-4125-80ee-bd477f4aa2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-924239040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400923d5-0b3a-40c0-8e3a-f555d38b7b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb456eea4144a209adfcf8cca298ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:04Z,use_quota=True,user_id='76a8ee3bf26c4d11a7bcaebe1f1edafa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dea2b9d-7ec2-42b9-a0b2-15b094c80c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dea2b9d-7ec2-42b9-a0b2-15b094c80c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e845c2b-5cb5-48e1-881a-c0294fe73236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e845c2b-5cb5-48e1-881a-c0294fe73236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400923d5-0b3a-40c0-8e3a-f555d38b7b36', 'volume_name': 'volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe68698-3a68-480b-a353-82b17a88442e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe68698-3a68-480b-a353-82b17a88442e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed965182-f6ed-464f-b8f1-88ce8caca553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:04 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Volume 400923d5-0b3a-40c0-8e3a-f555d38b7b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36', 'volume_size': 1} Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:04 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 1073741824" returned: 0 in 0.877s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:04 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 Sep 23 00:10:04 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:05 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563" returned: 0 in 0.357s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.185s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-924239040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400923d5-0b3a-40c0-8e3a-f555d38b7b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb456eea4144a209adfcf8cca298ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:04Z,use_quota=True,user_id='76a8ee3bf26c4d11a7bcaebe1f1edafa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Creating volume 400923d5-0b3a-40c0-8e3a-f555d38b7b36 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:05 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83dc8482-a030-422d-a701-23b9b8055b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8612ea87-6210-4fa5-abba-e9e1be403563', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:05 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36 1073741824 Sep 23 00:10:05 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff375724-621e-44af-8b87-59e89d2ef5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:05 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Volume volume-8612ea87-6210-4fa5-abba-e9e1be403563 (8612ea87-6210-4fa5-abba-e9e1be403563): created successfully Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff375724-621e-44af-8b87-59e89d2ef5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Flow 'volume_create_manager' (6e2823b6-2bad-4c28-9fc9-5e3cb93d6d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-5f26720d-b183-4c31-aaa3-a8beda17a2b1 req-87340e8e-0aad-463e-8eb4-e4da0e683462 tempest-VolumesSnapshotsTestJSON-1026243075 None] Created volume successfully. Sep 23 00:10:06 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36 1073741824" returned: 0 in 0.757s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:06 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36 Sep 23 00:10:06 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:06 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36" returned: 0 in 0.585s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.254s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Creating offline snapshot 297a04d0-0cae-4e88-bb53-f8a423a7ebdc of volume 8612ea87-6210-4fa5-abba-e9e1be403563 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:10:06 devstack cinder-volume[86481]: INFO oslo.privsep.daemon [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpuegc50c4/privsep.sock'] Sep 23 00:10:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed965182-f6ed-464f-b8f1-88ce8caca553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873e652c-227f-4697-9949-2dffc1a14ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:06 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpuegc50c4/privsep.sock Sep 23 00:10:06 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:06 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Volume volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36 (400923d5-0b3a-40c0-8e3a-f555d38b7b36): created successfully Sep 23 00:10:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873e652c-227f-4697-9949-2dffc1a14ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Flow 'volume_create_manager' (03eeb70b-32ef-49ad-9802-4ada90c98b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:06 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-728298e6-7dc3-4003-b0c5-0faf6038f812 tempest-TaggedAttachmentsTest-1453791693 None] Created volume successfully. Sep 23 00:10:08 devstack cinder-volume[86481]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 23 00:10:08 devstack cinder-volume[86481]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:10:08 devstack cinder-volume[86481]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 23 00:10:08 devstack cinder-volume[86481]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 00:10:08 devstack cinder-volume[86481]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:10:08 devstack cinder-volume[86481]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 23 00:10:08 devstack cinder-volume[86481]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:10:08 devstack cinder-volume[86481]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 00:10:08 devstack cinder-volume[86481]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 23 00:10:08 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:08 devstack cinder-volume[86481]: INFO oslo.privsep.daemon [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Spawned new privsep daemon via rootwrap Sep 23 00:10:08 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Accepted privsep connection to /tmp/tmpuegc50c4/privsep.sock {{(pid=86481) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 23 00:10:08 devstack cinder-volume[86481]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 23 00:10:08 devstack cinder-volume[86481]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 23 00:10:08 devstack cinder-volume[86481]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 23 00:10:08 devstack cinder-volume[86481]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87550 Sep 23 00:10:08 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[12524c43-7a69-431c-9e76-e20fe0de5cc4]: (2,) {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:08 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[3268ce9a-1491-4e7f-a6d7-0d6bbc119e4b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:08 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 Sep 23 00:10:08 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:09 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563" returned: 0 in 0.546s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:09 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc 1G Sep 23 00:10:09 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:09 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc 1G" returned: 0 in 0.684s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8612ea87-6210-4fa5-abba-e9e1be403563 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:09 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8612ea87-6210-4fa5-abba-e9e1be403563 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc Sep 23 00:10:09 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:10 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8612ea87-6210-4fa5-abba-e9e1be403563 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc" returned: 0 in 0.424s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:10 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc is being set with open permissions: ugo+rw Sep 23 00:10:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:10 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc Sep 23 00:10:10 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:10 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc" returned: 0 in 0.410s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:10 devstack sudo[87621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.info Sep 23 00:10:10 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:11 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.info" returned: 0 in 0.326s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:11 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.info is being set with open permissions: ugo+rw Sep 23 00:10:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:11 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.info Sep 23 00:10:11 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:11 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.info" returned: 0 in 0.439s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.798s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:11 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-6b5f96e6-df35-42fa-b24c-83dc9267b796 req-4c3d2f11-0015-45bd-a4c4-60b6eb86a505 tempest-VolumesSnapshotsTestJSON-1026243075 None] Create snapshot completed successfully Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Acquiring lock "cinder-297a04d0-0cae-4e88-bb53-f8a423a7ebdc-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "cinder-297a04d0-0cae-4e88-bb53-f8a423a7ebdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Acquiring lock "cinder-quobyte-8612ea87-6210-4fa5-abba-e9e1be403563" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "cinder-quobyte-8612ea87-6210-4fa5-abba-e9e1be403563" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Acquiring lock "cinder-quobyte-297a04d0-0cae-4e88-bb53-f8a423a7ebdc" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "cinder-quobyte-297a04d0-0cae-4e88-bb53-f8a423a7ebdc" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Deleting offline snapshot 297a04d0-0cae-4e88-bb53-f8a423a7ebdc of volume 8612ea87-6210-4fa5-abba-e9e1be403563 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] snapshot_file for this snap is: volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1dafa8-1367-4d28-80d5-1fe8b3befdc4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:12 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc Sep 23 00:10:12 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:12 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc" returned: 0 in 0.491s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8612ea87-6210-4fa5-abba-e9e1be403563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[806c5b7d-1da0-40dc-b05d-513086d3b55b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:13 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 Sep 23 00:10:13 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:13 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563" returned: 0 in 0.674s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:13 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc Sep 23 00:10:13 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:13 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc" returned: 0 in 0.447s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:13 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc Sep 23 00:10:13 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:14 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563.297a04d0-0cae-4e88-bb53-f8a423a7ebdc" returned: 0 in 0.295s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "cinder-quobyte-297a04d0-0cae-4e88-bb53-f8a423a7ebdc" released by "_delete_snapshot" :: held 2.137s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "cinder-quobyte-8612ea87-6210-4fa5-abba-e9e1be403563" released by "delete_snapshot" :: held 2.189s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:14 devstack cinder-volume[86481]: WARNING cinder.quota [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:10:14 devstack cinder-volume[86481]: WARNING cinder.quota [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:10:14 devstack cinder-volume[86481]: DEBUG cinder.quota [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Created reservations ['c6ae9ec8-4932-4e67-9623-0fdcd958c72d', '0465c39d-e626-40ed-b002-aad37a37a49c', '2740386d-6508-46a5-a853-90e1e574a00c', '04a406c1-a2bd-4d4f-8a67-f96623f97e71'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:10:14 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Delete snapshot completed successfully. Sep 23 00:10:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-2da7d19d-7ff9-43bd-b705-2272b56b69ee req-3385e76f-dffc-44ba-850d-7e8b1002999a tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "cinder-297a04d0-0cae-4e88-bb53-f8a423a7ebdc-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Acquiring lock "cinder-8612ea87-6210-4fa5-abba-e9e1be403563-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "cinder-8612ea87-6210-4fa5-abba-e9e1be403563-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Acquiring lock "cinder-quobyte-8612ea87-6210-4fa5-abba-e9e1be403563" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "cinder-quobyte-8612ea87-6210-4fa5-abba-e9e1be403563" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:16 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a602f20-11ec-4dbc-9504-fa64f1c12d6b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:16 devstack sudo[87799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 Sep 23 00:10:16 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:16 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563" returned: 0 in 0.433s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:16 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563 Sep 23 00:10:16 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:17 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8612ea87-6210-4fa5-abba-e9e1be403563" returned: 0 in 0.424s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "cinder-quobyte-8612ea87-6210-4fa5-abba-e9e1be403563" released by "delete_volume" :: held 1.022s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:17 devstack cinder-volume[86481]: WARNING cinder.quota [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:10:17 devstack cinder-volume[86481]: DEBUG cinder.quota [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Created reservations ['e0fa59d2-9839-4831-8610-765ad7f851e9', '6e807a40-8742-4d05-a03c-4cf344c89043', '72474a0c-60aa-40f7-88e0-caddaf2089f7', 'e339a7c9-23b2-479c-adaa-1625c31e772e'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:10:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:17 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:10:17 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:17 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.264s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:17 devstack cinder-volume[86481]: DEBUG cinder.manager [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Deleted volume successfully. Sep 23 00:10:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-5c08c741-a97e-4a7d-b940-00e03f8707ab req-f07dd41e-910f-4df9-aa1e-9a7402f92285 tempest-VolumesSnapshotsTestJSON-1026243075 None] Lock "cinder-8612ea87-6210-4fa5-abba-e9e1be403563-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Flow 'volume_create_manager' (3dd347bd-2057-4d3a-b2bc-5ce486158911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56085f4-3875-4eed-ad0f-467ac53cbd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56085f4-3875-4eed-ad0f-467ac53cbd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-375457914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68395227-486b-44de-9368-724f349993eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b32231ed93484a24b0527e0260d3f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:27Z,use_quota=True,user_id='b0910b450af146d29e9c40cc65fe466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4233d23f-2af5-43a0-b788-915fd34b680b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4233d23f-2af5-43a0-b788-915fd34b680b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6393b484-0361-4199-b0ba-fed6d0d3360a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6393b484-0361-4199-b0ba-fed6d0d3360a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68395227-486b-44de-9368-724f349993eb', 'volume_name': 'volume-68395227-486b-44de-9368-724f349993eb', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936a2871-e017-48f1-a788-d2e8ed3b81e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936a2871-e017-48f1-a788-d2e8ed3b81e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9401e0-f33f-43c8-98ee-459f060006e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:27 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Volume 68395227-486b-44de-9368-724f349993eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68395227-486b-44de-9368-724f349993eb', 'volume_size': 1} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-375457914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68395227-486b-44de-9368-724f349993eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b32231ed93484a24b0527e0260d3f06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:27Z,use_quota=True,user_id='b0910b450af146d29e9c40cc65fe466d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Creating volume 68395227-486b-44de-9368-724f349993eb {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:27 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:10:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-68395227-486b-44de-9368-724f349993eb 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:27 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-68395227-486b-44de-9368-724f349993eb 1073741824 Sep 23 00:10:27 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:28 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-68395227-486b-44de-9368-724f349993eb 1073741824" returned: 0 in 0.810s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-68395227-486b-44de-9368-724f349993eb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:28 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-68395227-486b-44de-9368-724f349993eb Sep 23 00:10:28 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:28 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-68395227-486b-44de-9368-724f349993eb" returned: 0 in 0.452s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9401e0-f33f-43c8-98ee-459f060006e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68395227-486b-44de-9368-724f349993eb', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92caf5ec-a4ea-4bf9-8ad8-e5b9b122484d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:28 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Volume volume-68395227-486b-44de-9368-724f349993eb (68395227-486b-44de-9368-724f349993eb): created successfully Sep 23 00:10:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92caf5ec-a4ea-4bf9-8ad8-e5b9b122484d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Flow 'volume_create_manager' (3dd347bd-2057-4d3a-b2bc-5ce486158911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:28 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-2d2765c0-32d3-45fb-b30d-dc1d7ef3ed4a req-8e9620c1-7a21-4138-bec4-f48b84db7b59 tempest-VolumesGetTestJSON-315171057 None] Created volume successfully. Sep 23 00:10:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Acquiring lock "cinder-68395227-486b-44de-9368-724f349993eb-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Lock "cinder-68395227-486b-44de-9368-724f349993eb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Acquiring lock "cinder-quobyte-68395227-486b-44de-9368-724f349993eb" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Lock "cinder-quobyte-68395227-486b-44de-9368-724f349993eb" acquired by "delete_volume" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:30 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebee28d-bb67-4caf-9398-515343db6233]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-68395227-486b-44de-9368-724f349993eb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:30 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-68395227-486b-44de-9368-724f349993eb Sep 23 00:10:30 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:30 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-68395227-486b-44de-9368-724f349993eb" returned: 0 in 0.533s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-68395227-486b-44de-9368-724f349993eb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:30 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-68395227-486b-44de-9368-724f349993eb Sep 23 00:10:30 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:31 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-68395227-486b-44de-9368-724f349993eb" returned: 0 in 0.551s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:31 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Lock "cinder-quobyte-68395227-486b-44de-9368-724f349993eb" released by "delete_volume" :: held 1.160s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:31 devstack cinder-volume[86481]: DEBUG cinder.quota [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Created reservations ['52aa841f-3332-43d3-9838-6e8e78f65bb3', '0fbb13a8-4f51-4004-9ebe-3cf1b094247a', '05e3b82c-2322-405d-81ce-ce762099e4e5', '04341cf9-a242-4a18-8a43-c1c19dd55b9e'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:10:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:31 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:10:31 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:32 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.645s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:32 devstack cinder-volume[86481]: DEBUG cinder.manager [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:32 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Deleted volume successfully. Sep 23 00:10:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-1f052946-4f34-44eb-8dbb-ce78e7c79aae req-c2ab3b2e-eb67-47db-9fd7-b814f3b251e2 tempest-VolumesGetTestJSON-315171057 None] Lock "cinder-68395227-486b-44de-9368-724f349993eb-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Flow 'volume_create_manager' (b2e04b07-eece-45f3-b77e-ab2f7e358b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c786a1-4ece-4bc1-b29b-9ecb22793633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c786a1-4ece-4bc1-b29b-9ecb22793633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1894793544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3bafe1-6d43-4412-be60-4c80f7c43da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aaba67968284ac4879ffd573087d4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:36Z,use_quota=True,user_id='6769543a38f54c61bdbf135e438368d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948b3820-dd93-4178-87e8-7d0d2b29bb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948b3820-dd93-4178-87e8-7d0d2b29bb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8019147-d978-45eb-9839-672856d5bf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8019147-d978-45eb-9839-672856d5bf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3bafe1-6d43-4412-be60-4c80f7c43da2', 'volume_name': 'volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730e0c27-3cd7-4a56-a7c1-c625f45cdaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730e0c27-3cd7-4a56-a7c1-c625f45cdaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b6e6e1-031e-4fa6-a298-57f6cfeda39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:36 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Volume ec3bafe1-6d43-4412-be60-4c80f7c43da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2', 'volume_size': 1} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1894793544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3bafe1-6d43-4412-be60-4c80f7c43da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aaba67968284ac4879ffd573087d4d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:36Z,use_quota=True,user_id='6769543a38f54c61bdbf135e438368d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Creating volume ec3bafe1-6d43-4412-be60-4c80f7c43da2 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:36 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:10:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:36 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2 1073741824 Sep 23 00:10:36 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:38 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2 1073741824" returned: 0 in 1.064s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:38 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2 Sep 23 00:10:38 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:39 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2" returned: 0 in 0.869s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b6e6e1-031e-4fa6-a298-57f6cfeda39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34b3575-7a80-4388-90a2-642625299542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:39 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Volume volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2 (ec3bafe1-6d43-4412-be60-4c80f7c43da2): created successfully Sep 23 00:10:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34b3575-7a80-4388-90a2-642625299542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Flow 'volume_create_manager' (b2e04b07-eece-45f3-b77e-ab2f7e358b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:39 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ee347c96-ba55-44be-b7d1-65fa3fdc01fb tempest-VolumesAdminNegativeTest-1914456268 None] Created volume successfully. Sep 23 00:10:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Acquiring lock "cinder-ec3bafe1-6d43-4412-be60-4c80f7c43da2-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Lock "cinder-ec3bafe1-6d43-4412-be60-4c80f7c43da2-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Acquiring lock "cinder-quobyte-ec3bafe1-6d43-4412-be60-4c80f7c43da2" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Lock "cinder-quobyte-ec3bafe1-6d43-4412-be60-4c80f7c43da2" acquired by "delete_volume" :: waited 0.088s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:41 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bfbcb3-62b0-46eb-90d1-a6d409c6775b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:42 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2 Sep 23 00:10:42 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:42 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2" returned: 0 in 1.096s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:43 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2 Sep 23 00:10:43 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:43 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ec3bafe1-6d43-4412-be60-4c80f7c43da2" returned: 0 in 0.881s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Lock "cinder-quobyte-ec3bafe1-6d43-4412-be60-4c80f7c43da2" released by "delete_volume" :: held 2.155s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Created reservations ['6221459b-2f3e-47a5-8374-2c6ece4e1485', 'd9d3ba08-5ebf-4a88-a442-8d4aadda3ff7', '6c97ad36-c0a9-41e1-8bb4-82319f83ec13', 'c5ef48cf-6d87-431a-8700-19e830d52b8c'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:44 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:10:44 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:44 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:10:44 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:44 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Flow 'volume_create_manager' (6e1ea3d0-651b-4388-9c10-270f80bfc58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ba1d20-ff09-4c65-8bd1-1efe2877b9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ba1d20-ff09-4c65-8bd1-1efe2877b9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-688645930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be4bd3b-facd-4d02-8604-82bf610f27dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='feb9ebd9450d4288a9f1bbd921bb529e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:45Z,use_quota=True,user_id='b206cf99e8774a4bbed13e8d28041195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c709917-7d08-4ec0-bd9b-78865b1f4b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c709917-7d08-4ec0-bd9b-78865b1f4b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:45 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d249b7-6b1f-4689-966a-5e8f77db2bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d249b7-6b1f-4689-966a-5e8f77db2bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0be4bd3b-facd-4d02-8604-82bf610f27dd', 'volume_name': 'volume-0be4bd3b-facd-4d02-8604-82bf610f27dd', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bc7f0a-ade9-4cdd-9d69-f4e735244066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bc7f0a-ade9-4cdd-9d69-f4e735244066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da91eaef-fdaa-4f76-994d-71d4695e6824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:45 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Volume 0be4bd3b-facd-4d02-8604-82bf610f27dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0be4bd3b-facd-4d02-8604-82bf610f27dd', 'volume_size': 1} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-688645930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be4bd3b-facd-4d02-8604-82bf610f27dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='feb9ebd9450d4288a9f1bbd921bb529e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:45Z,use_quota=True,user_id='b206cf99e8774a4bbed13e8d28041195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Creating volume 0be4bd3b-facd-4d02-8604-82bf610f27dd {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:45 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0be4bd3b-facd-4d02-8604-82bf610f27dd 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 1.029s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:45 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Deleted volume successfully. Sep 23 00:10:45 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0be4bd3b-facd-4d02-8604-82bf610f27dd 1073741824 Sep 23 00:10:45 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-af1dcab3-fecb-4499-ad5c-f1d8083f7276 tempest-VolumesAdminNegativeTest-1914456268 None] Lock "cinder-ec3bafe1-6d43-4412-be60-4c80f7c43da2-delete_volume" released by "delete_volume" :: held 4.164s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:45 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.922s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 8 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:10:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:10:46 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0be4bd3b-facd-4d02-8604-82bf610f27dd 1073741824" returned: 0 in 1.343s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0be4bd3b-facd-4d02-8604-82bf610f27dd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:47 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0be4bd3b-facd-4d02-8604-82bf610f27dd Sep 23 00:10:47 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:47 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0be4bd3b-facd-4d02-8604-82bf610f27dd" returned: 0 in 0.587s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da91eaef-fdaa-4f76-994d-71d4695e6824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be4bd3b-facd-4d02-8604-82bf610f27dd', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f975be-d380-497c-8106-cfb2190fb876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:47 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Volume volume-0be4bd3b-facd-4d02-8604-82bf610f27dd (0be4bd3b-facd-4d02-8604-82bf610f27dd): created successfully Sep 23 00:10:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f975be-d380-497c-8106-cfb2190fb876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Flow 'volume_create_manager' (6e1ea3d0-651b-4388-9c10-270f80bfc58a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:47 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-73743008-ba74-4cec-ad47-8489afb9bce4 tempest-VolumesTestJSON-391437509 None] Created volume successfully. Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Flow 'volume_create_manager' (630d9290-fe1a-491d-bb64-8e01728c45c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd57ca90-38a4-463d-a71a-35efd3ce670b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd57ca90-38a4-463d-a71a-35efd3ce670b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-608830233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743b7421-04e8-4357-b7d0-ea19593d43f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='feb9ebd9450d4288a9f1bbd921bb529e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:49Z,use_quota=True,user_id='b206cf99e8774a4bbed13e8d28041195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b97f53-ecce-4650-9386-f5ec24d2568f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b97f53-ecce-4650-9386-f5ec24d2568f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06db23f-445c-44b9-8639-a33350a0f60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06db23f-445c-44b9-8639-a33350a0f60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743b7421-04e8-4357-b7d0-ea19593d43f5', 'volume_name': 'volume-743b7421-04e8-4357-b7d0-ea19593d43f5', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f03014e-b5e5-4af7-8e5f-5bdf83f209f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f03014e-b5e5-4af7-8e5f-5bdf83f209f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa1a7b4-a8bf-434c-a410-f10a20ee9e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:49 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Volume 743b7421-04e8-4357-b7d0-ea19593d43f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743b7421-04e8-4357-b7d0-ea19593d43f5', 'volume_size': 1} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-608830233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743b7421-04e8-4357-b7d0-ea19593d43f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='feb9ebd9450d4288a9f1bbd921bb529e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:49Z,use_quota=True,user_id='b206cf99e8774a4bbed13e8d28041195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Creating volume 743b7421-04e8-4357-b7d0-ea19593d43f5 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:49 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:10:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-743b7421-04e8-4357-b7d0-ea19593d43f5 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:49 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-743b7421-04e8-4357-b7d0-ea19593d43f5 1073741824 Sep 23 00:10:49 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:50 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-743b7421-04e8-4357-b7d0-ea19593d43f5 1073741824" returned: 0 in 0.892s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-743b7421-04e8-4357-b7d0-ea19593d43f5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:50 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-743b7421-04e8-4357-b7d0-ea19593d43f5 Sep 23 00:10:50 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:50 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-743b7421-04e8-4357-b7d0-ea19593d43f5" returned: 0 in 0.309s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa1a7b4-a8bf-434c-a410-f10a20ee9e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743b7421-04e8-4357-b7d0-ea19593d43f5', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36cb613-0860-4d3a-9e2d-19ca2412ff89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:50 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Volume volume-743b7421-04e8-4357-b7d0-ea19593d43f5 (743b7421-04e8-4357-b7d0-ea19593d43f5): created successfully Sep 23 00:10:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36cb613-0860-4d3a-9e2d-19ca2412ff89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Flow 'volume_create_manager' (630d9290-fe1a-491d-bb64-8e01728c45c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:50 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-93ad06ec-d73c-4e9e-a87d-d7e11ce110f6 tempest-VolumesTestJSON-391437509 None] Created volume successfully. Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Flow 'volume_create_manager' (3bffa812-81fe-436f-9297-e1cd93f5a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0422e651-7fc5-43bb-b54a-41bc4d027075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0422e651-7fc5-43bb-b54a-41bc4d027075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2136671185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104ee61d-be14-408a-a49c-383f911450fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='feb9ebd9450d4288a9f1bbd921bb529e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:53Z,use_quota=True,user_id='b206cf99e8774a4bbed13e8d28041195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8766f15-2121-4a70-8f68-5b173cf97efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8766f15-2121-4a70-8f68-5b173cf97efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea9dff0-8def-45f3-92ad-d30fe09c64db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea9dff0-8def-45f3-92ad-d30fe09c64db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '104ee61d-be14-408a-a49c-383f911450fa', 'volume_name': 'volume-104ee61d-be14-408a-a49c-383f911450fa', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4856534-c88a-43a8-b777-182263f1eb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4856534-c88a-43a8-b777-182263f1eb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d779a083-4b2f-4240-b916-d019cbab5c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:52 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Volume 104ee61d-be14-408a-a49c-383f911450fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-104ee61d-be14-408a-a49c-383f911450fa', 'volume_size': 1} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2136671185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104ee61d-be14-408a-a49c-383f911450fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='feb9ebd9450d4288a9f1bbd921bb529e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:10:53Z,use_quota=True,user_id='b206cf99e8774a4bbed13e8d28041195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Creating volume 104ee61d-be14-408a-a49c-383f911450fa {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:10:52 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:10:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-104ee61d-be14-408a-a49c-383f911450fa 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:52 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-104ee61d-be14-408a-a49c-383f911450fa 1073741824 Sep 23 00:10:52 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:53 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-104ee61d-be14-408a-a49c-383f911450fa 1073741824" returned: 0 in 0.672s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-104ee61d-be14-408a-a49c-383f911450fa {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:53 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-104ee61d-be14-408a-a49c-383f911450fa Sep 23 00:10:53 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:53 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-104ee61d-be14-408a-a49c-383f911450fa" returned: 0 in 0.337s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:10:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d779a083-4b2f-4240-b916-d019cbab5c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-104ee61d-be14-408a-a49c-383f911450fa', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f298b4-513e-4665-9401-2f782add52ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:10:53 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Volume volume-104ee61d-be14-408a-a49c-383f911450fa (104ee61d-be14-408a-a49c-383f911450fa): created successfully Sep 23 00:10:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f298b4-513e-4665-9401-2f782add52ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:10:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Flow 'volume_create_manager' (3bffa812-81fe-436f-9297-e1cd93f5a05c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:10:53 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-65f994b7-38e4-4fa3-908e-75f8fc30788c tempest-VolumesTestJSON-391437509 None] Created volume successfully. Sep 23 00:10:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Acquiring lock "cinder-104ee61d-be14-408a-a49c-383f911450fa-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Lock "cinder-104ee61d-be14-408a-a49c-383f911450fa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:55 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=39,cinder:UPDATE=47,cinder:DELETE=8,cinder:INSERT=14 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:55 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=38,cinder:UPDATE=58,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Acquiring lock "cinder-quobyte-104ee61d-be14-408a-a49c-383f911450fa" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Lock "cinder-quobyte-104ee61d-be14-408a-a49c-383f911450fa" acquired by "delete_volume" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:56 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aee9c4b-0270-4b1c-85a2-58d70c6a7fe3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-104ee61d-be14-408a-a49c-383f911450fa {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:56 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-104ee61d-be14-408a-a49c-383f911450fa Sep 23 00:10:56 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:56 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-104ee61d-be14-408a-a49c-383f911450fa" returned: 0 in 0.468s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-104ee61d-be14-408a-a49c-383f911450fa {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:56 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-104ee61d-be14-408a-a49c-383f911450fa Sep 23 00:10:56 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:56 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-104ee61d-be14-408a-a49c-383f911450fa" returned: 0 in 0.321s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Lock "cinder-quobyte-104ee61d-be14-408a-a49c-383f911450fa" released by "delete_volume" :: held 0.877s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:57 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Created reservations ['bfc55f09-3a7c-4ca9-a8dc-c8077e9c3395', '38110cfd-fcbc-4048-8277-5345d9611da9', '59d8dac6-98ee-4826-a189-e1e72d149ac4', 'fa11a9c1-1e9b-4fef-a2d8-a8b1e9409659'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:10:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:57 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:10:57 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:57 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.318s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:57 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:57 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Deleted volume successfully. Sep 23 00:10:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a0b1f9f5-a8ab-40b7-9a7e-37501911e4de tempest-VolumesTestJSON-391437509 None] Lock "cinder-104ee61d-be14-408a-a49c-383f911450fa-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Acquiring lock "cinder-743b7421-04e8-4357-b7d0-ea19593d43f5-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Lock "cinder-743b7421-04e8-4357-b7d0-ea19593d43f5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Acquiring lock "cinder-quobyte-743b7421-04e8-4357-b7d0-ea19593d43f5" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:10:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Lock "cinder-quobyte-743b7421-04e8-4357-b7d0-ea19593d43f5" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:10:58 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7429c8f-1ce8-4071-8011-b8dabffa42af]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:10:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-743b7421-04e8-4357-b7d0-ea19593d43f5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:58 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-743b7421-04e8-4357-b7d0-ea19593d43f5 Sep 23 00:10:58 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:58 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-743b7421-04e8-4357-b7d0-ea19593d43f5" returned: 0 in 0.530s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-743b7421-04e8-4357-b7d0-ea19593d43f5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:58 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-743b7421-04e8-4357-b7d0-ea19593d43f5 Sep 23 00:10:58 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:59 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-743b7421-04e8-4357-b7d0-ea19593d43f5" returned: 0 in 0.411s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Lock "cinder-quobyte-743b7421-04e8-4357-b7d0-ea19593d43f5" released by "delete_volume" :: held 1.007s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:10:59 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Created reservations ['6073b434-b47c-4e67-861c-461c6a30e1cf', 'ae5db8c1-5233-4d49-b2d1-7539c0fc76b4', 'f500cf8d-93ec-4caf-9a0b-53006ca08a2f', '4207e176-5fdb-45f9-89ba-82cf3fe3c965'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:10:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:59 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:10:59 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:59 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.316s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:59 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Deleted volume successfully. Sep 23 00:10:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4eaf0ca-35da-4fef-8ea8-7d3250316133 tempest-VolumesTestJSON-391437509 None] Lock "cinder-743b7421-04e8-4357-b7d0-ea19593d43f5-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Acquiring lock "cinder-0be4bd3b-facd-4d02-8604-82bf610f27dd-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Lock "cinder-0be4bd3b-facd-4d02-8604-82bf610f27dd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Acquiring lock "cinder-quobyte-0be4bd3b-facd-4d02-8604-82bf610f27dd" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Lock "cinder-quobyte-0be4bd3b-facd-4d02-8604-82bf610f27dd" acquired by "delete_volume" :: waited 0.063s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:00 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1607779e-7ba3-4142-947d-f57320806071]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0be4bd3b-facd-4d02-8604-82bf610f27dd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:00 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0be4bd3b-facd-4d02-8604-82bf610f27dd Sep 23 00:11:00 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:01 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0be4bd3b-facd-4d02-8604-82bf610f27dd" returned: 0 in 0.413s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0be4bd3b-facd-4d02-8604-82bf610f27dd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:01 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0be4bd3b-facd-4d02-8604-82bf610f27dd Sep 23 00:11:01 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:01 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0be4bd3b-facd-4d02-8604-82bf610f27dd" returned: 0 in 0.334s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Lock "cinder-quobyte-0be4bd3b-facd-4d02-8604-82bf610f27dd" released by "delete_volume" :: held 0.827s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:01 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Created reservations ['69b43324-0bf8-4b37-b237-d8901acf3f08', 'cc8008ef-58a6-47fa-a6b5-3642d7517512', '6448bd41-1ff3-4d09-b181-78c1aa9ac41e', 'ee3c0b59-a977-42a3-a527-eeb26668be52'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:01 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:11:01 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:02 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.356s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:02 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:02 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Deleted volume successfully. Sep 23 00:11:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dc66a5c1-2891-4a29-852a-1b3708039cdd tempest-VolumesTestJSON-391437509 None] Lock "cinder-0be4bd3b-facd-4d02-8604-82bf610f27dd-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Flow 'volume_create_manager' (f6af2b7a-ce42-4dc5-8f8e-261d304152ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a931b447-f7c6-4d6c-80e9-4c109b65241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a931b447-f7c6-4d6c-80e9-4c109b65241f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1074745731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9efc33-f17b-460f-bd55-6b8bfcd5fb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc74bcfe1a7e494fb384f5caa1cbb5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:12Z,use_quota=True,user_id='dc5719905c1a45b3bad8704e39d6b7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8ff962-1141-4c35-bbae-c0943b6634ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8ff962-1141-4c35-bbae-c0943b6634ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dc31a7-b543-439b-acd7-da3a4f69f174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dc31a7-b543-439b-acd7-da3a4f69f174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9efc33-f17b-460f-bd55-6b8bfcd5fb51', 'volume_name': 'volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372f60e8-f5c7-407b-80a1-03223f500180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372f60e8-f5c7-407b-80a1-03223f500180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad267ac-d7df-443d-a8b8-ca935ce5e245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Volume 4c9efc33-f17b-460f-bd55-6b8bfcd5fb51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51', 'volume_size': 1} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1074745731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9efc33-f17b-460f-bd55-6b8bfcd5fb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc74bcfe1a7e494fb384f5caa1cbb5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:12Z,use_quota=True,user_id='dc5719905c1a45b3bad8704e39d6b7e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Creating volume 4c9efc33-f17b-460f-bd55-6b8bfcd5fb51 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:11 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:11:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:12 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51 1073741824 Sep 23 00:11:12 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:12 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51 1073741824" returned: 0 in 0.724s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:12 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51 Sep 23 00:11:12 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:13 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51" returned: 0 in 0.617s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad267ac-d7df-443d-a8b8-ca935ce5e245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a25d2ef-4aa5-4482-a531-f315a047b916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:13 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Volume volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51 (4c9efc33-f17b-460f-bd55-6b8bfcd5fb51): created successfully Sep 23 00:11:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a25d2ef-4aa5-4482-a531-f315a047b916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Flow 'volume_create_manager' (f6af2b7a-ce42-4dc5-8f8e-261d304152ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:13 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2bbfa6c4-cb4f-4736-9e62-f399ec368781 tempest-DeleteServersTestJSON-1031641973 None] Created volume successfully. Sep 23 00:11:19 devstack cinder-volume[86481]: WARNING py.warnings [req-f79516fb-72ed-47c4-affe-aa9a94029866 req-3f54a321-5975-497f-942b-a11ee4413159 tempest-DeleteServersTestJSON-1031641973 None] /opt/stack/cinder/cinder/db/api.py:2571: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 23 00:11:19 devstack cinder-volume[86481]: .first() Sep 23 00:11:19 devstack cinder-volume[86481]: Sep 23 00:11:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-f79516fb-72ed-47c4-affe-aa9a94029866 req-3f54a321-5975-497f-942b-a11ee4413159 tempest-DeleteServersTestJSON-1031641973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-f79516fb-72ed-47c4-affe-aa9a94029866 req-3f54a321-5975-497f-942b-a11ee4413159 tempest-DeleteServersTestJSON-1031641973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-f79516fb-72ed-47c4-affe-aa9a94029866 req-3f54a321-5975-497f-942b-a11ee4413159 tempest-DeleteServersTestJSON-1031641973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-59847ccb-a968-443f-96f4-864f4ffa7bc6 req-f1e9f080-a993-41a0-8d4f-1ddeb02c0d86 tempest-TaggedAttachmentsTest-1453791693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-59847ccb-a968-443f-96f4-864f4ffa7bc6 req-f1e9f080-a993-41a0-8d4f-1ddeb02c0d86 tempest-TaggedAttachmentsTest-1453791693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-59847ccb-a968-443f-96f4-864f4ffa7bc6 req-f1e9f080-a993-41a0-8d4f-1ddeb02c0d86 tempest-TaggedAttachmentsTest-1453791693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-f79516fb-72ed-47c4-affe-aa9a94029866 req-3f54a321-5975-497f-942b-a11ee4413159 tempest-DeleteServersTestJSON-1031641973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06f74f3d-f1e8-48a8-af8c-e4639c0aa59e', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:11:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-59847ccb-a968-443f-96f4-864f4ffa7bc6 req-f1e9f080-a993-41a0-8d4f-1ddeb02c0d86 tempest-TaggedAttachmentsTest-1453791693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce7eded6-752a-4f23-bb84-a9486388f48f', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:11:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-f79516fb-72ed-47c4-affe-aa9a94029866 req-3f54a321-5975-497f-942b-a11ee4413159 tempest-DeleteServersTestJSON-1031641973 None] attachment_update completed successfully. Sep 23 00:11:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-59847ccb-a968-443f-96f4-864f4ffa7bc6 req-f1e9f080-a993-41a0-8d4f-1ddeb02c0d86 tempest-TaggedAttachmentsTest-1453791693 None] attachment_update completed successfully. Sep 23 00:11:22 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-372f8112-18f9-401b-ade5-f708f3f3b4e8 tempest-GroupsV314Test-528020183 None] Group tempest-GroupsV314Test-Group-259559284: creating Sep 23 00:11:22 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-372f8112-18f9-401b-ade5-f708f3f3b4e8 tempest-GroupsV314Test-528020183 None] Group tempest-GroupsV314Test-Group-259559284: created successfully Sep 23 00:11:22 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-372f8112-18f9-401b-ade5-f708f3f3b4e8 tempest-GroupsV314Test-528020183 None] Create group completed successfully. Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Flow 'volume_create_manager' (74f6dc9d-68c3-467e-acd9-4d5e44849ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af349d00-8871-4699-b148-59d943e12117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af349d00-8871-4699-b148-59d943e12117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1219430302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7fc2c996-0521-41d1-ab7e-7f312feb8cc3,host='devstack@QuobyteHD#QuobyteHD',id=3d4c090b-42c1-4663-8938-2e2e0abb9afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad7ae80a284642d3984957e0f6f9e053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:25Z,use_quota=True,user_id='5f044462cd974053a209677455629e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef60feb-67e3-4a33-aa6b-cae5d1d968f8),volume_type_id=1ef60feb-67e3-4a33-aa6b-cae5d1d968f8)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f69d7ee-2413-4e5b-a0cf-81a98957cefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f69d7ee-2413-4e5b-a0cf-81a98957cefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1747d55f-6e80-464a-98f4-c0dee19b026a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1747d55f-6e80-464a-98f4-c0dee19b026a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d4c090b-42c1-4663-8938-2e2e0abb9afd', 'volume_name': 'volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13e6116-0e0a-4f68-8c23-f0850062d363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13e6116-0e0a-4f68-8c23-f0850062d363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f883ac-4c93-4a19-bd39-18cddbd58521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:24 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Volume 3d4c090b-42c1-4663-8938-2e2e0abb9afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd', 'volume_size': 1} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7fc2c996-0521-41d1-ab7e-7f312feb8cc3,created_at=2026-09-22T22:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1219430302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7fc2c996-0521-41d1-ab7e-7f312feb8cc3,host='devstack@QuobyteHD#QuobyteHD',id=3d4c090b-42c1-4663-8938-2e2e0abb9afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad7ae80a284642d3984957e0f6f9e053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:11:25Z,use_quota=True,user_id='5f044462cd974053a209677455629e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef60feb-67e3-4a33-aa6b-cae5d1d968f8),volume_type_id=1ef60feb-67e3-4a33-aa6b-cae5d1d968f8)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Creating volume 3d4c090b-42c1-4663-8938-2e2e0abb9afd {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:11:24 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:11:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:24 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd 1073741824 Sep 23 00:11:24 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:25 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd 1073741824" returned: 0 in 0.775s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:25 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd Sep 23 00:11:25 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:25 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-7c193575-a5fe-4d29-9bfd-1df9bcdaf47c req-7066099d-8138-493a-b056-9e45bd04aa90 tempest-DeleteServersTestJSON-1031641973 None] Terminate volume connection completed successfully. Sep 23 00:11:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-7c193575-a5fe-4d29-9bfd-1df9bcdaf47c req-7066099d-8138-493a-b056-9e45bd04aa90 tempest-DeleteServersTestJSON-1031641973 None] Deleting attachment 06f74f3d-f1e8-48a8-af8c-e4639c0aa59e. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:11:26 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-13a6323e-8b44-456a-9be4-7a94a51ee962 req-264bf9aa-4ecf-45b9-b811-3143e176ab5c tempest-TaggedAttachmentsTest-1453791693 None] Terminate volume connection completed successfully. Sep 23 00:11:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-13a6323e-8b44-456a-9be4-7a94a51ee962 req-264bf9aa-4ecf-45b9-b811-3143e176ab5c tempest-TaggedAttachmentsTest-1453791693 None] Deleting attachment ce7eded6-752a-4f23-bb84-a9486388f48f. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:11:26 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd" returned: 0 in 0.470s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:11:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f883ac-4c93-4a19-bd39-18cddbd58521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22477fb-49c6-4632-9beb-295eaab498a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:11:26 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Volume volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd (3d4c090b-42c1-4663-8938-2e2e0abb9afd): created successfully Sep 23 00:11:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22477fb-49c6-4632-9beb-295eaab498a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:11:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Flow 'volume_create_manager' (74f6dc9d-68c3-467e-acd9-4d5e44849ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:11:26 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5084ae5b-6b21-4c6a-9981-b46d8014be03 tempest-GroupsV314Test-528020183 None] Created volume successfully. Sep 23 00:11:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:28 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Cloning volume 3d4c090b-42c1-4663-8938-2e2e0abb9afd to volume ada14498-e7e6-46e3-bbf5-746e1c387dd7 Sep 23 00:11:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Creating offline snapshot 186330f1-6287-47a5-ad84-426b898a2fd7 of volume 3d4c090b-42c1-4663-8938-2e2e0abb9afd {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:11:28 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93d6e62-dfd3-473a-af9c-4b11d8c3445d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:28 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd Sep 23 00:11:28 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Acquiring lock "cinder-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Lock "cinder-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Acquiring lock "cinder-quobyte-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Lock "cinder-quobyte-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:29 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:29 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca27e6e3-7b66-4d98-a88a-9a98666d3514]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd" returned: 0 in 0.879s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:29 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 1G Sep 23 00:11:29 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:29 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51 Sep 23 00:11:29 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:29 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51" returned: 0 in 0.516s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:29 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51 Sep 23 00:11:29 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:29 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 1G" returned: 0 in 0.628s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:29 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 Sep 23 00:11:29 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:30 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51" returned: 0 in 0.400s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Lock "cinder-quobyte-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51" released by "delete_volume" :: held 0.989s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Created reservations ['9c782d4c-bd41-4dd1-85dc-39905e7b291f', '0b4eb8d8-04bf-4acf-81c2-b18ab8b1a9d8', '3f2d87c3-b487-4f57-a76c-3714fb9e2e90', '53255705-a3a2-4b8f-a9c6-69a96dbca1f8'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:30 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:11:30 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:30 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7" returned: 0 in 0.570s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:30 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:30 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 Sep 23 00:11:30 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:30 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7" returned: 0 in 0.295s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:30 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.376s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:30 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Deleted volume successfully. Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c74732d4-9f45-4d77-9b24-18bfcd01a34b tempest-DeleteServersTestJSON-1031641973 None] Lock "cinder-4c9efc33-f17b-460f-bd55-6b8bfcd5fb51-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:30 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.info Sep 23 00:11:30 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:31 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.info" returned: 0 in 0.388s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:31 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:31 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.info Sep 23 00:11:31 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:31 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.info" returned: 0 in 0.438s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Acquiring lock "cinder-quobyte-ada14498-e7e6-46e3-bbf5-746e1c387dd7" by "_copy_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Lock "cinder-quobyte-ada14498-e7e6-46e3-bbf5-746e1c387dd7" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] snapshot: 186330f1-6287-47a5-ad84-426b898a2fd7, volume: ada14498-e7e6-46e3-bbf5-746e1c387dd7, {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18a42c5-cd52-4ed7-bfd0-b58464a783c0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:31 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 Sep 23 00:11:31 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:32 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7" returned: 0 in 0.546s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:11:32 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4416d1d-4b13-4e06-8f5b-cd32a8fbf50c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:32 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd Sep 23 00:11:32 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:32 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd" returned: 0 in 0.512s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:11:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Creating direct copy from snapshot {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:11:32 devstack cinder-volume[86481]: DEBUG cinder.utils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Path /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7 not found in is_blk_device check {{(pid=86481) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:11:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:32 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7 Sep 23 00:11:32 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:40 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=48,cinder:INSERT=7,cinder:UPDATE=45,cinder:DELETE=2 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:40 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=44,cinder:INSERT=13,cinder:UPDATE=40,cinder:DELETE=4 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:42 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7" returned: 0 in 9.441s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:42 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd, size 1024.00 MB, duration 9.44 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:11:42 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Converted 1024.00 MB image at 108.44 MB/s Sep 23 00:11:42 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:11:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:42 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7 Sep 23 00:11:42 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:42 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7" returned: 0 in 0.398s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Lock "cinder-quobyte-ada14498-e7e6-46e3-bbf5-746e1c387dd7" released by "_copy_volume_from_snapshot" :: held 11.049s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Acquiring lock "cinder-quobyte-186330f1-6287-47a5-ad84-426b898a2fd7" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Lock "cinder-quobyte-186330f1-6287-47a5-ad84-426b898a2fd7" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Deleting offline snapshot 186330f1-6287-47a5-ad84-426b898a2fd7 of volume 3d4c090b-42c1-4663-8938-2e2e0abb9afd {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:11:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] snapshot_file for this snap is: volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:11:42 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb4bf46-f9f2-438a-bb6f-731c3620e6e4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:43 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 Sep 23 00:11:43 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:43 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7" returned: 0 in 0.538s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:11:43 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[40904262-12ea-4098-b5fb-c99805c1ce46]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:43 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd Sep 23 00:11:43 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:44 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd" returned: 0 in 0.925s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:44 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 Sep 23 00:11:44 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:11:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:44 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:11:44 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:45 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7" returned: 0 in 0.770s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:45 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7 Sep 23 00:11:45 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:45 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.553s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:45 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd.186330f1-6287-47a5-ad84-426b898a2fd7" returned: 0 in 0.607s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Lock "cinder-quobyte-186330f1-6287-47a5-ad84-426b898a2fd7" released by "_delete_snapshot" :: held 3.051s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.704s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Acquiring lock "cinder-400923d5-0b3a-40c0-8e3a-f555d38b7b36-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Lock "cinder-400923d5-0b3a-40c0-8e3a-f555d38b7b36-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:46 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d14efa6d-475b-4285-acfe-2c4cbcfd69f0 tempest-GroupsV314Test-528020183 None] Create group from source-group-7fc2c996-0521-41d1-ab7e-7f312feb8cc3 completed successfully. Sep 23 00:11:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Acquiring lock "cinder-quobyte-400923d5-0b3a-40c0-8e3a-f555d38b7b36" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Lock "cinder-quobyte-400923d5-0b3a-40c0-8e3a-f555d38b7b36" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:46 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[86384ed3-137e-4f4d-ab72-dda011c75a7c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:46 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36 Sep 23 00:11:46 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:46 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36" returned: 0 in 0.832s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:47 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36 Sep 23 00:11:47 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Acquiring lock "cinder-quobyte-ada14498-e7e6-46e3-bbf5-746e1c387dd7" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Lock "cinder-quobyte-ada14498-e7e6-46e3-bbf5-746e1c387dd7" acquired by "delete_volume" :: waited 0.043s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8600c2c1-74bc-459f-8448-9957edd27ec1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:47 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7 Sep 23 00:11:47 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:47 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-400923d5-0b3a-40c0-8e3a-f555d38b7b36" returned: 0 in 0.479s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Lock "cinder-quobyte-400923d5-0b3a-40c0-8e3a-f555d38b7b36" released by "delete_volume" :: held 1.417s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Created reservations ['716dc431-5809-47a1-ab97-5b9fe6b675f4', '41370f28-bfa5-484e-89ab-f30b708daf39', 'efddf173-33cf-4d33-a313-315cc78e1468', '74eae81d-f5ae-4b00-a098-0b5c85ba9b0a'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:47 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:11:47 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:47 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7" returned: 0 in 0.687s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:47 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7 Sep 23 00:11:47 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:48 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.512s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:48 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Deleted volume successfully. Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1c4b66ce-f855-491a-927d-fba33320ca93 tempest-TaggedAttachmentsTest-1453791693 None] Lock "cinder-400923d5-0b3a-40c0-8e3a-f555d38b7b36-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:48 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ada14498-e7e6-46e3-bbf5-746e1c387dd7" returned: 0 in 0.562s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Lock "cinder-quobyte-ada14498-e7e6-46e3-bbf5-746e1c387dd7" released by "delete_volume" :: held 1.352s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Created reservations ['1554c32d-a7e8-4314-94a2-f4e537516b97'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:48 devstack cinder-volume[86481]: WARNING cinder.quota [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1622336337 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1622336337, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:11:48 devstack cinder-volume[86481]: WARNING cinder.quota [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1622336337 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1622336337, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Created reservations ['914e3c9b-3c11-4733-98e6-81079bb290c7', 'edb8073e-6eff-4153-a90b-a4c842883b7b', 'd39d0abb-cdae-4638-bad0-296b0a07abc3', '313b6995-7605-45cc-b81f-c5677797e340'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:49 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:11:49 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:49 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.458s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:49 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:49 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2324f42b-34ef-43d6-9a06-75199ee90383 tempest-GroupsV314Test-528020183 None] Delete group completed successfully. Sep 23 00:11:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Acquiring lock "cinder-quobyte-3d4c090b-42c1-4663-8938-2e2e0abb9afd" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:11:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Lock "cinder-quobyte-3d4c090b-42c1-4663-8938-2e2e0abb9afd" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:11:50 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2361c0c-95e5-4257-9b39-e754c64bf564]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:11:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:50 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd Sep 23 00:11:50 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:50 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd" returned: 0 in 0.439s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:50 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd Sep 23 00:11:50 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:51 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3d4c090b-42c1-4663-8938-2e2e0abb9afd" returned: 0 in 0.336s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Lock "cinder-quobyte-3d4c090b-42c1-4663-8938-2e2e0abb9afd" released by "delete_volume" :: held 0.872s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:11:51 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Created reservations ['53022aae-7722-4cec-ace9-65e9a33a4662'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:51 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Created reservations ['180bb133-e5ec-47e0-a56f-ab13b0112c08', '459960bc-6848-41b3-8766-4dfeb8e13a5e', '499d0ce6-68e2-40f6-abbf-5dbf1f047042', '15cf1c20-66f0-4407-8267-4972e2388784'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:11:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:51 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:11:51 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:51 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.343s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:51 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:51 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-885d61ea-17ad-420a-b371-29cfdf17aa78 tempest-GroupsV314Test-528020183 None] Delete group completed successfully. Sep 23 00:12:01 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=28,cinder:SELECT=27,cinder:INSERT=5 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:01 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=37,cinder:SELECT=19,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Flow 'volume_create_manager' (29e118a7-f191-426a-8fcb-75324392465a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d8d1a8-b611-4c08-923b-9bd68130d793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d8d1a8-b611-4c08-923b-9bd68130d793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1089436881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f33682-595f-4dd6-b69a-041d95484739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713edb2f26d94794b2d3f4e9bbd4a973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:23Z,use_quota=True,user_id='6abaa8e32d9c4f268775c0b03b8e8ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c817f957-07d1-4a0a-a753-380c2aac6317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c817f957-07d1-4a0a-a753-380c2aac6317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd58b780-5134-4d2e-8d7d-defcc3bf9eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd58b780-5134-4d2e-8d7d-defcc3bf9eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f33682-595f-4dd6-b69a-041d95484739', 'volume_name': 'volume-32f33682-595f-4dd6-b69a-041d95484739', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67903643-ae39-42a1-96ee-5435595215e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67903643-ae39-42a1-96ee-5435595215e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b580af2-192f-4720-a2c5-0e0bbf1a0ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:23 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Volume 32f33682-595f-4dd6-b69a-041d95484739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f33682-595f-4dd6-b69a-041d95484739', 'volume_size': 1} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1089436881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f33682-595f-4dd6-b69a-041d95484739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713edb2f26d94794b2d3f4e9bbd4a973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:23Z,use_quota=True,user_id='6abaa8e32d9c4f268775c0b03b8e8ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Creating volume 32f33682-595f-4dd6-b69a-041d95484739 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:23 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:12:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-32f33682-595f-4dd6-b69a-041d95484739 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:23 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-32f33682-595f-4dd6-b69a-041d95484739 1073741824 Sep 23 00:12:23 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:24 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-32f33682-595f-4dd6-b69a-041d95484739 1073741824" returned: 0 in 0.947s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-32f33682-595f-4dd6-b69a-041d95484739 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:24 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-32f33682-595f-4dd6-b69a-041d95484739 Sep 23 00:12:24 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:24 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Flow 'volume_create_manager' (781c30ba-b2de-4310-a59b-49c344efad33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c837290b-9b02-4d5f-bdda-a06d86b19069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:25 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c837290b-9b02-4d5f-bdda-a06d86b19069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-507281316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0db7a2-4aa1-4f36-bac3-fea0109b33e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120790f6c8604274b971ae415bb1a1dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:25Z,use_quota=True,user_id='dec06c9da4604573aba4b47268af1d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17ce68a-5261-4b2c-a3ef-e65b7b3b8780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17ce68a-5261-4b2c-a3ef-e65b7b3b8780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e561d69e-1e7e-4d6b-95c2-6bcc12adc2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e561d69e-1e7e-4d6b-95c2-6bcc12adc2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0db7a2-4aa1-4f36-bac3-fea0109b33e7', 'volume_name': 'volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5711784-03d6-495f-8997-52e4a684d815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5711784-03d6-495f-8997-52e4a684d815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad9ba3b-2e6f-43ea-9b60-7bca71eeaa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:25 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Volume ac0db7a2-4aa1-4f36-bac3-fea0109b33e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7', 'volume_size': 1} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-32f33682-595f-4dd6-b69a-041d95484739" returned: 0 in 0.643s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-507281316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0db7a2-4aa1-4f36-bac3-fea0109b33e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120790f6c8604274b971ae415bb1a1dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:25Z,use_quota=True,user_id='dec06c9da4604573aba4b47268af1d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Creating volume ac0db7a2-4aa1-4f36-bac3-fea0109b33e7 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:25 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b580af2-192f-4720-a2c5-0e0bbf1a0ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f33682-595f-4dd6-b69a-041d95484739', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8475e3-d1e8-4c50-95ae-46cb036f5565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:25 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7 1073741824 Sep 23 00:12:25 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:25 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Volume volume-32f33682-595f-4dd6-b69a-041d95484739 (32f33682-595f-4dd6-b69a-041d95484739): created successfully Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8475e3-d1e8-4c50-95ae-46cb036f5565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Flow 'volume_create_manager' (29e118a7-f191-426a-8fcb-75324392465a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:25 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-97482089-1110-4d6e-8580-84dd8fae1fdd tempest-ServerRescueNegativeTestJSON-1416587943 None] Created volume successfully. Sep 23 00:12:26 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7 1073741824" returned: 0 in 1.071s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:26 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7 Sep 23 00:12:26 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:27 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7" returned: 0 in 0.818s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad9ba3b-2e6f-43ea-9b60-7bca71eeaa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6413fd32-9524-4a3e-9092-6feb36000009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:27 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Volume volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7 (ac0db7a2-4aa1-4f36-bac3-fea0109b33e7): created successfully Sep 23 00:12:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6413fd32-9524-4a3e-9092-6feb36000009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Flow 'volume_create_manager' (781c30ba-b2de-4310-a59b-49c344efad33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:27 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d868755f-7fa0-455d-984b-2d1d7fca3269 tempest-VolumeQuotasAdminTestJSON-321120167 None] Created volume successfully. Sep 23 00:12:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Acquiring lock "cinder-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "cinder-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Acquiring lock "cinder-quobyte-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "cinder-quobyte-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:28 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9556c858-ecaf-4ef6-bf93-a59e6a0f5759]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:29 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7 Sep 23 00:12:29 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:29 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7" returned: 0 in 1.051s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:29 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7 Sep 23 00:12:29 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:30 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7" returned: 0 in 0.632s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "cinder-quobyte-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7" released by "delete_volume" :: held 1.783s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:30 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Created reservations ['47c6d587-5f60-4c0b-9ebd-2faa2a059070', 'ccb8a94c-8a19-4d2e-aaca-69916f0b1cc2', '526c5aab-c2a3-4bde-acb6-9f07d51d8b9c', '04c92a18-4059-4b7d-8216-b1b813f81b3d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:30 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:12:30 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:31 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.818s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:31 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:31 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Deleted volume successfully. Sep 23 00:12:31 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-19fe3680-3b74-4f60-b15c-0d77c3f96125 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "cinder-ac0db7a2-4aa1-4f36-bac3-fea0109b33e7-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Flow 'volume_create_manager' (05a28221-3472-436b-ab35-1e98c6752bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e80637b-4c48-4987-8e44-bf894701c686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e80637b-4c48-4987-8e44-bf894701c686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1623329629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97ead67-9a54-4eae-b220-6ceafe9a07a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120790f6c8604274b971ae415bb1a1dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:33Z,use_quota=True,user_id='dec06c9da4604573aba4b47268af1d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893adac1-581c-4203-bacc-9bbd69038087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893adac1-581c-4203-bacc-9bbd69038087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a0a8ef-118f-4339-b6f9-981f295a1152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a0a8ef-118f-4339-b6f9-981f295a1152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f97ead67-9a54-4eae-b220-6ceafe9a07a0', 'volume_name': 'volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e36aac-dea6-4d90-80b9-3cc18e6d16df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e36aac-dea6-4d90-80b9-3cc18e6d16df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54a7788-c6dd-4624-abe4-7f322c40a19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:32 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Volume f97ead67-9a54-4eae-b220-6ceafe9a07a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0', 'volume_size': 1} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1623329629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97ead67-9a54-4eae-b220-6ceafe9a07a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='120790f6c8604274b971ae415bb1a1dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:33Z,use_quota=True,user_id='dec06c9da4604573aba4b47268af1d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Creating volume f97ead67-9a54-4eae-b220-6ceafe9a07a0 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:32 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:12:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:32 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0 1073741824 Sep 23 00:12:32 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:34 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0 1073741824" returned: 0 in 1.423s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:34 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0 Sep 23 00:12:34 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:35 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0" returned: 0 in 0.645s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] <== create_volume: return (2185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54a7788-c6dd-4624-abe4-7f322c40a19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51b5e0d-066e-4c82-b311-791ed1dd4e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:35 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Volume volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0 (f97ead67-9a54-4eae-b220-6ceafe9a07a0): created successfully Sep 23 00:12:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51b5e0d-066e-4c82-b311-791ed1dd4e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Flow 'volume_create_manager' (05a28221-3472-436b-ab35-1e98c6752bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:35 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5558326e-703b-4365-861f-ce58fc9ee970 tempest-VolumeQuotasAdminTestJSON-321120167 None] Created volume successfully. Sep 23 00:12:38 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-80b60661-419d-4a9e-8fad-20e8b5a84e27 tempest-VolumeQuotasAdminTestJSON-344527350 None] Transfer volume completed successfully. Sep 23 00:12:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Acquiring lock "cinder-f97ead67-9a54-4eae-b220-6ceafe9a07a0-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Lock "cinder-f97ead67-9a54-4eae-b220-6ceafe9a07a0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Acquiring lock "cinder-quobyte-f97ead67-9a54-4eae-b220-6ceafe9a07a0" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Lock "cinder-quobyte-f97ead67-9a54-4eae-b220-6ceafe9a07a0" acquired by "delete_volume" :: waited 0.062s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:39 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7b7fe9-a0b7-4bdf-83a3-8635d43b669c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:40 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0 Sep 23 00:12:40 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:41 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0" returned: 0 in 1.149s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:41 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0 Sep 23 00:12:41 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:41 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f97ead67-9a54-4eae-b220-6ceafe9a07a0" returned: 0 in 0.677s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Lock "cinder-quobyte-f97ead67-9a54-4eae-b220-6ceafe9a07a0" released by "delete_volume" :: held 1.951s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:41 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Created reservations ['8f2eff5d-475b-49d5-85d6-289f412ec2b1', 'e535baa0-bd9f-4449-bbaa-1acbf8133ebd', 'c2e69ef6-65df-41d8-9e42-6390f8e494a9', '55e8512d-f1b2-49e4-8ab6-3b79d77169fe'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:42 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:12:42 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:42 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.529s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:42 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:42 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Deleted volume successfully. Sep 23 00:12:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ac033233-b51a-4671-a16f-67ca42260f65 tempest-VolumeQuotasAdminTestJSON-1061335754 None] Lock "cinder-f97ead67-9a54-4eae-b220-6ceafe9a07a0-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:12:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:44 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:12:44 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:45 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.677s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:12:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 8 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:12:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:12:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Acquiring lock "cinder-32f33682-595f-4dd6-b69a-041d95484739-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Lock "cinder-32f33682-595f-4dd6-b69a-041d95484739-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Acquiring lock "cinder-quobyte-32f33682-595f-4dd6-b69a-041d95484739" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Lock "cinder-quobyte-32f33682-595f-4dd6-b69a-041d95484739" acquired by "delete_volume" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:48 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2417bb-d6ff-4424-9cae-1d1153ee9b3e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-32f33682-595f-4dd6-b69a-041d95484739 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:48 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-32f33682-595f-4dd6-b69a-041d95484739 Sep 23 00:12:48 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:48 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-32f33682-595f-4dd6-b69a-041d95484739" returned: 0 in 0.738s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-32f33682-595f-4dd6-b69a-041d95484739 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:48 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-32f33682-595f-4dd6-b69a-041d95484739 Sep 23 00:12:48 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:49 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-32f33682-595f-4dd6-b69a-041d95484739" returned: 0 in 0.520s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Lock "cinder-quobyte-32f33682-595f-4dd6-b69a-041d95484739" released by "delete_volume" :: held 1.350s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:49 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Created reservations ['ddfa49d0-ad1d-49a8-8f85-50fcb0d97122', 'aefd13fd-3ce3-4991-9370-947570404588', '08077a3e-ae8b-4822-b146-2b1baf4e22f7', '0d280f29-8bcd-4819-9319-59baf0e1dc9c'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:12:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:49 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:12:49 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:50 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.436s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:50 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:50 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Deleted volume successfully. Sep 23 00:12:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221277e2-9a9b-47d0-9f37-8497e09e6a93 tempest-ServerRescueNegativeTestJSON-1416587943 None] Lock "cinder-32f33682-595f-4dd6-b69a-041d95484739-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Flow 'volume_create_manager' (d0fd6306-90ea-49de-817d-e45e50fc961f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9c56c6-dd28-460e-9081-1358cfe25c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9c56c6-dd28-460e-9081-1358cfe25c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2040790575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a62bd8-713d-4088-97fe-4bdf2843d1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d9dddbd5374fada14b43606d8866d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:57Z,use_quota=True,user_id='bf57d875122240e7b842432e30644b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef4e958-593d-41ef-a942-a9cc6d03cf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef4e958-593d-41ef-a942-a9cc6d03cf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336ae05f-7afa-41dd-b4b1-0b8c612f0232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336ae05f-7afa-41dd-b4b1-0b8c612f0232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a62bd8-713d-4088-97fe-4bdf2843d1a8', 'volume_name': 'volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069ddfa2-2ba7-45b0-8091-8bb194fd4545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069ddfa2-2ba7-45b0-8091-8bb194fd4545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799f0640-07a8-450c-84b2-2656a8795d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:57 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Volume 29a62bd8-713d-4088-97fe-4bdf2843d1a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8', 'volume_size': 1} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2040790575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a62bd8-713d-4088-97fe-4bdf2843d1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1d9dddbd5374fada14b43606d8866d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:57Z,use_quota=True,user_id='bf57d875122240e7b842432e30644b35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Creating volume 29a62bd8-713d-4088-97fe-4bdf2843d1a8 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:57 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:12:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:57 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8 1073741824 Sep 23 00:12:57 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:58 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8 1073741824" returned: 0 in 0.835s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:58 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8 Sep 23 00:12:58 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:59 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8" returned: 0 in 0.595s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799f0640-07a8-450c-84b2-2656a8795d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1783c876-fdcd-4a31-952b-c47ff6aa14db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:59 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Volume volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8 (29a62bd8-713d-4088-97fe-4bdf2843d1a8): created successfully Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1783c876-fdcd-4a31-952b-c47ff6aa14db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Flow 'volume_create_manager' (d0fd6306-90ea-49de-817d-e45e50fc961f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e73f1165-497b-4af6-b8a4-132f178c32da tempest-AttachVolumeShelveTestJSON-1649827677 None] Created volume successfully. Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Flow 'volume_create_manager' (1001eb1c-bc45-4136-98c4-12c810ebb363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2ee93e-da43-4cce-903b-8801f5e7a631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2ee93e-da43-4cce-903b-8801f5e7a631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1411369188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbd6610-992e-4af0-91a9-387c777093f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25288e7d0523427eb826b79542e87cfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:59Z,use_quota=True,user_id='f2579202892b47b99bb27a35cbf1bbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee1b313-dc23-489b-b0e3-ef03993f203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee1b313-dc23-489b-b0e3-ef03993f203a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdee82f-7642-4ebb-8006-21aeeca8072d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecdee82f-7642-4ebb-8006-21aeeca8072d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cbd6610-992e-4af0-91a9-387c777093f8', 'volume_name': 'volume-4cbd6610-992e-4af0-91a9-387c777093f8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6386e186-b12c-4a4d-8407-cbc4aad9bc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6386e186-b12c-4a4d-8407-cbc4aad9bc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81066f1-30ab-4cbb-81c4-621421052b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:59 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Volume 4cbd6610-992e-4af0-91a9-387c777093f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cbd6610-992e-4af0-91a9-387c777093f8', 'volume_size': 1} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1411369188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbd6610-992e-4af0-91a9-387c777093f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25288e7d0523427eb826b79542e87cfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:59Z,use_quota=True,user_id='f2579202892b47b99bb27a35cbf1bbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Creating volume 4cbd6610-992e-4af0-91a9-387c777093f8 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:59 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:12:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4cbd6610-992e-4af0-91a9-387c777093f8 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:59 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4cbd6610-992e-4af0-91a9-387c777093f8 1073741824 Sep 23 00:12:59 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:00 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4cbd6610-992e-4af0-91a9-387c777093f8 1073741824" returned: 0 in 0.763s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4cbd6610-992e-4af0-91a9-387c777093f8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:00 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4cbd6610-992e-4af0-91a9-387c777093f8 Sep 23 00:13:00 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:00 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4cbd6610-992e-4af0-91a9-387c777093f8" returned: 0 in 0.382s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c81066f1-30ab-4cbb-81c4-621421052b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cbd6610-992e-4af0-91a9-387c777093f8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f195229-bb27-4081-b6e6-183ae78c1184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:00 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Volume volume-4cbd6610-992e-4af0-91a9-387c777093f8 (4cbd6610-992e-4af0-91a9-387c777093f8): created successfully Sep 23 00:13:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f195229-bb27-4081-b6e6-183ae78c1184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Flow 'volume_create_manager' (1001eb1c-bc45-4136-98c4-12c810ebb363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:00 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2ff78774-e6e2-4e2c-9824-5bd9390cb28d tempest-VolumesServicesTestJSON-1159341219 None] Created volume successfully. Sep 23 00:13:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Acquiring lock "cinder-4cbd6610-992e-4af0-91a9-387c777093f8-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Lock "cinder-4cbd6610-992e-4af0-91a9-387c777093f8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Acquiring lock "cinder-quobyte-4cbd6610-992e-4af0-91a9-387c777093f8" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Lock "cinder-quobyte-4cbd6610-992e-4af0-91a9-387c777093f8" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:01 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b9f07f-3910-43db-a074-ee380f5d1f5e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4cbd6610-992e-4af0-91a9-387c777093f8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:02 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4cbd6610-992e-4af0-91a9-387c777093f8 Sep 23 00:13:02 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:02 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4cbd6610-992e-4af0-91a9-387c777093f8" returned: 0 in 0.599s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4cbd6610-992e-4af0-91a9-387c777093f8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:02 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4cbd6610-992e-4af0-91a9-387c777093f8 Sep 23 00:13:02 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:02 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4cbd6610-992e-4af0-91a9-387c777093f8" returned: 0 in 0.402s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Lock "cinder-quobyte-4cbd6610-992e-4af0-91a9-387c777093f8" released by "delete_volume" :: held 1.103s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:03 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Created reservations ['cb17f084-ad30-40bb-a2b7-997cf39a3290', '693ccc9b-324b-44aa-a040-3b2ff9192024', 'b0411164-341b-4e31-bace-e684609e8312', '56cbd520-2068-457c-95b7-b3c0bf016d23'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:13:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:03 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:13:03 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:03 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.672s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:03 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:03 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Deleted volume successfully. Sep 23 00:13:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-865c1999-6997-47ac-9efe-da3bd64f4d77 tempest-VolumesServicesTestJSON-1159341219 None] Lock "cinder-4cbd6610-992e-4af0-91a9-387c777093f8-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:13 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=49,cinder:SELECT=30,cinder:INSERT=7,cinder:DELETE=5 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:15 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=32,cinder:UPDATE=46,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-0ba564c8-bbc7-433c-9c5a-005d981f005a req-6d5b0efa-3a72-4997-93fb-e506b92faec7 tempest-AttachVolumeShelveTestJSON-1649827677 None] No connector for attachment 9fdeb6c1-62d2-4123-9620-a96d186965d3; skipping storage backend terminate_connection call. {{(pid=86481) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 23 00:13:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-0ba564c8-bbc7-433c-9c5a-005d981f005a req-6d5b0efa-3a72-4997-93fb-e506b92faec7 tempest-AttachVolumeShelveTestJSON-1649827677 None] Deleting attachment 9fdeb6c1-62d2-4123-9620-a96d186965d3. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:13:27 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=2 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:34 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Flow 'volume_create_manager' (5fc8350a-4801-4c16-bce2-381648d5aec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5bdeaa6-41ee-4f35-8010-1cf503202e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5bdeaa6-41ee-4f35-8010-1cf503202e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1811985780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9be3428-a78e-4e5c-ba92-d528941610c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2976120b56477e8e635442521a893e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:35Z,use_quota=True,user_id='fa9e8d80209846d895f87cdd0ee37077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e529e75c-90ed-44ba-9fa6-55f5ff31e4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e529e75c-90ed-44ba-9fa6-55f5ff31e4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7868f2-289b-4a47-aa2b-2264e845b98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc7868f2-289b-4a47-aa2b-2264e845b98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9be3428-a78e-4e5c-ba92-d528941610c0', 'volume_name': 'volume-b9be3428-a78e-4e5c-ba92-d528941610c0', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a45414-4e96-4961-a4ce-d99b83227d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a45414-4e96-4961-a4ce-d99b83227d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695f0a18-6124-460a-9c6c-4c4044a9bbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:35 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Volume b9be3428-a78e-4e5c-ba92-d528941610c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9be3428-a78e-4e5c-ba92-d528941610c0', 'volume_size': 1} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1811985780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9be3428-a78e-4e5c-ba92-d528941610c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2976120b56477e8e635442521a893e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:35Z,use_quota=True,user_id='fa9e8d80209846d895f87cdd0ee37077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Creating volume b9be3428-a78e-4e5c-ba92-d528941610c0 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:35 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:13:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b9be3428-a78e-4e5c-ba92-d528941610c0 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:35 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b9be3428-a78e-4e5c-ba92-d528941610c0 1073741824 Sep 23 00:13:35 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:36 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b9be3428-a78e-4e5c-ba92-d528941610c0 1073741824" returned: 0 in 0.947s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b9be3428-a78e-4e5c-ba92-d528941610c0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:36 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b9be3428-a78e-4e5c-ba92-d528941610c0 Sep 23 00:13:36 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:36 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b9be3428-a78e-4e5c-ba92-d528941610c0" returned: 0 in 0.488s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695f0a18-6124-460a-9c6c-4c4044a9bbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9be3428-a78e-4e5c-ba92-d528941610c0', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656e7631-2b90-416e-9eee-81ac325980f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:36 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Volume volume-b9be3428-a78e-4e5c-ba92-d528941610c0 (b9be3428-a78e-4e5c-ba92-d528941610c0): created successfully Sep 23 00:13:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656e7631-2b90-416e-9eee-81ac325980f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Flow 'volume_create_manager' (5fc8350a-4801-4c16-bce2-381648d5aec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:36 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2b20a328-7a1d-43ed-b7a9-6f69c45a4eee tempest-ServerActionsTestOtherA-723500123 None] Created volume successfully. Sep 23 00:13:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:13:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.102s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:44 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:13:44 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:45 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.656s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:13:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 8 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:13:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:13:46 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:46 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Flow 'volume_create_manager' (9a160a1a-ffc2-44bc-8fe9-b7ce5401f314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd47c7df-5e82-49cf-8d93-3cbd726dd30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd47c7df-5e82-49cf-8d93-3cbd726dd30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1954614688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3735825c-bfd0-4d8d-aea1-80ffd67f3ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3522a30ad74a6cbe825b4c87ef383a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:53Z,use_quota=True,user_id='5945aec88e42405db150897ed4ad2975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a83b75e-e662-419e-902c-2b2ea2c29bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a83b75e-e662-419e-902c-2b2ea2c29bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbb085e-41ba-492f-99f5-18d919074289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbb085e-41ba-492f-99f5-18d919074289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3735825c-bfd0-4d8d-aea1-80ffd67f3ef8', 'volume_name': 'volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc6fed5-f041-438e-bdd7-ba35c5657866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc6fed5-f041-438e-bdd7-ba35c5657866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbca7342-8ec7-4fa8-a7c5-6bac73e53c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:53 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Volume 3735825c-bfd0-4d8d-aea1-80ffd67f3ef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8', 'volume_size': 1} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1954614688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3735825c-bfd0-4d8d-aea1-80ffd67f3ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3522a30ad74a6cbe825b4c87ef383a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:13:53Z,use_quota=True,user_id='5945aec88e42405db150897ed4ad2975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Creating volume 3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:13:53 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:13:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:53 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 1073741824 Sep 23 00:13:53 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:54 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 1073741824" returned: 0 in 0.823s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:54 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 Sep 23 00:13:54 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:55 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" returned: 0 in 0.435s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:13:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbca7342-8ec7-4fa8-a7c5-6bac73e53c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316566c7-0a93-448d-92ed-1a8d921bbf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:13:55 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Volume volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 (3735825c-bfd0-4d8d-aea1-80ffd67f3ef8): created successfully Sep 23 00:13:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316566c7-0a93-448d-92ed-1a8d921bbf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:13:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Flow 'volume_create_manager' (9a160a1a-ffc2-44bc-8fe9-b7ce5401f314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:13:55 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-26db0ba7-3175-463b-b9bb-8bb96d855170 tempest-VolumesActionsTest-423571339 None] Created volume successfully. Sep 23 00:14:05 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:05 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Acquiring lock "cinder-29a62bd8-713d-4088-97fe-4bdf2843d1a8-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Lock "cinder-29a62bd8-713d-4088-97fe-4bdf2843d1a8-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Acquiring lock "cinder-quobyte-29a62bd8-713d-4088-97fe-4bdf2843d1a8" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Lock "cinder-quobyte-29a62bd8-713d-4088-97fe-4bdf2843d1a8" acquired by "delete_volume" :: waited 0.067s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:10 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d7802e-2ebe-4aa1-a3c1-84cc89ef0d5a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:11 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8 Sep 23 00:14:11 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:11 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8" returned: 0 in 0.797s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:11 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8 Sep 23 00:14:11 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:12 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29a62bd8-713d-4088-97fe-4bdf2843d1a8" returned: 0 in 1.052s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Lock "cinder-quobyte-29a62bd8-713d-4088-97fe-4bdf2843d1a8" released by "delete_volume" :: held 2.030s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:12 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Created reservations ['ab0d3b65-9cf6-4819-a4f7-d551609af0de', '1f72c258-09f5-463d-97c0-2a92dfe4933f', '9b425f59-db72-4595-9fd1-245c2ebc9da3', '36577e60-1334-4cdf-9f7d-a1333194823a'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:14:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:13 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:14:13 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:13 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.742s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:13 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:13 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Deleted volume successfully. Sep 23 00:14:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-741ea20d-be68-40b1-890b-2e867af9e96c tempest-AttachVolumeShelveTestJSON-1649827677 None] Lock "cinder-29a62bd8-713d-4088-97fe-4bdf2843d1a8-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73678e8a-537a-42d7-88c9-52bdd9e18d81 tempest-VolumesActionsTest-423571339 None] Acquiring lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" by "attach_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73678e8a-537a-42d7-88c9-52bdd9e18d81 tempest-VolumesActionsTest-423571339 None] Lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" acquired by "attach_volume" :: waited 0.034s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-73678e8a-537a-42d7-88c9-52bdd9e18d81 tempest-VolumesActionsTest-423571339 None] Attaching volume 3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 to instance 93f3618d-ecb5-4c1c-82d6-a9554362b510 at mountpoint /dev/vdb on host None. Sep 23 00:14:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-73678e8a-537a-42d7-88c9-52bdd9e18d81 tempest-VolumesActionsTest-423571339 None] Attach volume completed successfully. Sep 23 00:14:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73678e8a-537a-42d7-88c9-52bdd9e18d81 tempest-VolumesActionsTest-423571339 None] Lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" released by "attach_volume" :: held 0.169s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5143c663-f6c1-4f12-abcd-cf40e798f190 tempest-VolumesActionsTest-423571339 None] Acquiring lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8-detach_volume" by "detach_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5143c663-f6c1-4f12-abcd-cf40e798f190 tempest-VolumesActionsTest-423571339 None] Lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5143c663-f6c1-4f12-abcd-cf40e798f190 tempest-VolumesActionsTest-423571339 None] Detaching volume 3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 from instance 93f3618d-ecb5-4c1c-82d6-a9554362b510. Sep 23 00:14:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5143c663-f6c1-4f12-abcd-cf40e798f190 tempest-VolumesActionsTest-423571339 None] Detach volume completed successfully. Sep 23 00:14:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5143c663-f6c1-4f12-abcd-cf40e798f190 tempest-VolumesActionsTest-423571339 None] Lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:26 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:26 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=11 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-438c08a3-f5cd-4eb4-a805-77e9aa206699 req-908686d3-47a9-4189-9507-57771ffdfb6b tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-438c08a3-f5cd-4eb4-a805-77e9aa206699 req-908686d3-47a9-4189-9507-57771ffdfb6b tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-438c08a3-f5cd-4eb4-a805-77e9aa206699 req-908686d3-47a9-4189-9507-57771ffdfb6b tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-438c08a3-f5cd-4eb4-a805-77e9aa206699 req-908686d3-47a9-4189-9507-57771ffdfb6b tempest-ServerActionsTestOtherA-723500123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-b9be3428-a78e-4e5c-ba92-d528941610c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '751f5b1f-5d79-4f2b-a879-07335c24bf19', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:14:28 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-438c08a3-f5cd-4eb4-a805-77e9aa206699 req-908686d3-47a9-4189-9507-57771ffdfb6b tempest-ServerActionsTestOtherA-723500123 None] attachment_update completed successfully. Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Flow 'volume_create_manager' (9ef95ab7-91f6-4ab0-b412-cf0414d1c49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e1d7ed-a705-4487-8b77-80530e8ab6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e1d7ed-a705-4487-8b77-80530e8ab6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-226640108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d4f8daca642f3b274214280ef4ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:32Z,use_quota=True,user_id='ffa5e9acb2ee47a5bdd3fa82ad6b11a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210992c4-f296-4b06-ae30-5a90842f0edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210992c4-f296-4b06-ae30-5a90842f0edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892d74a3-380d-4520-b337-fa42be87499e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892d74a3-380d-4520-b337-fa42be87499e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3', 'volume_name': 'volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6523f9-88bf-4ddd-9e41-fd8dcf9ba7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6523f9-88bf-4ddd-9e41-fd8dcf9ba7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e782385-8b9e-4bc1-9e48-3ba0058cac6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:31 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Volume f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3', 'volume_size': 1} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-226640108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d4f8daca642f3b274214280ef4ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:32Z,use_quota=True,user_id='ffa5e9acb2ee47a5bdd3fa82ad6b11a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Creating volume f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:31 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:14:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:31 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3 1073741824 Sep 23 00:14:31 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5f9aa409-40d2-40e2-95df-dcc131ca8d6a tempest-VolumesActionsTest-423571339 None] Acquiring lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" by "attach_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5f9aa409-40d2-40e2-95df-dcc131ca8d6a tempest-VolumesActionsTest-423571339 None] Lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" acquired by "attach_volume" :: waited 0.047s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:32 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5f9aa409-40d2-40e2-95df-dcc131ca8d6a tempest-VolumesActionsTest-423571339 None] Attaching volume 3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 to instance aadafe31-67b8-414c-b96c-e95adb49c434 at mountpoint /dev/vdb on host None. Sep 23 00:14:32 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5f9aa409-40d2-40e2-95df-dcc131ca8d6a tempest-VolumesActionsTest-423571339 None] Attach volume completed successfully. Sep 23 00:14:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5f9aa409-40d2-40e2-95df-dcc131ca8d6a tempest-VolumesActionsTest-423571339 None] Lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" released by "attach_volume" :: held 0.241s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:32 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3 1073741824" returned: 0 in 1.046s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:33 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3 Sep 23 00:14:33 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:33 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3" returned: 0 in 0.840s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e782385-8b9e-4bc1-9e48-3ba0058cac6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960f8214-7824-4eea-b981-8356f492e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:34 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Volume volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3 (f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3): created successfully Sep 23 00:14:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960f8214-7824-4eea-b981-8356f492e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Flow 'volume_create_manager' (9ef95ab7-91f6-4ab0-b412-cf0414d1c49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:34 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-abd41a89-3288-4333-95d2-ae0abc95fc4e tempest-AttachVolumeTestJSON-2138545175 None] Created volume successfully. Sep 23 00:14:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a5621486-076a-475d-a65f-160b4fd9992a tempest-VolumesActionsTest-423571339 None] Acquiring lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8-detach_volume" by "detach_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a5621486-076a-475d-a65f-160b4fd9992a tempest-VolumesActionsTest-423571339 None] Lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8-detach_volume" acquired by "detach_volume" :: waited 0.107s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:34 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a5621486-076a-475d-a65f-160b4fd9992a tempest-VolumesActionsTest-423571339 None] Detaching volume 3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 from instance aadafe31-67b8-414c-b96c-e95adb49c434. Sep 23 00:14:34 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a5621486-076a-475d-a65f-160b4fd9992a tempest-VolumesActionsTest-423571339 None] Detach volume completed successfully. Sep 23 00:14:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a5621486-076a-475d-a65f-160b4fd9992a tempest-VolumesActionsTest-423571339 None] Lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8-detach_volume" released by "detach_volume" :: held 0.131s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:35 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-d2481627-963a-4b0a-a8a1-91f252e5ef29 req-4463c6ba-ec01-4700-82d9-b548bfc8a3be tempest-ServerActionsTestOtherA-723500123 None] Terminate volume connection completed successfully. Sep 23 00:14:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-d2481627-963a-4b0a-a8a1-91f252e5ef29 req-4463c6ba-ec01-4700-82d9-b548bfc8a3be tempest-ServerActionsTestOtherA-723500123 None] Deleting attachment 751f5b1f-5d79-4f2b-a879-07335c24bf19. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:14:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-d2481627-963a-4b0a-a8a1-91f252e5ef29 req-be0ec6ec-d296-42c2-b142-5e13cdda500b tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-d2481627-963a-4b0a-a8a1-91f252e5ef29 req-be0ec6ec-d296-42c2-b142-5e13cdda500b tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-d2481627-963a-4b0a-a8a1-91f252e5ef29 req-be0ec6ec-d296-42c2-b142-5e13cdda500b tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-20abe32f-43b3-48e7-9f3a-4df9f0590d8b req-0cab1857-8773-4fb9-9e9f-ccc66336e64a tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-20abe32f-43b3-48e7-9f3a-4df9f0590d8b req-0cab1857-8773-4fb9-9e9f-ccc66336e64a tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-20abe32f-43b3-48e7-9f3a-4df9f0590d8b req-0cab1857-8773-4fb9-9e9f-ccc66336e64a tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-d2481627-963a-4b0a-a8a1-91f252e5ef29 req-be0ec6ec-d296-42c2-b142-5e13cdda500b tempest-ServerActionsTestOtherA-723500123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-b9be3428-a78e-4e5c-ba92-d528941610c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b1326a1-a29b-4463-8d4a-41ac9a94d927', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:14:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-20abe32f-43b3-48e7-9f3a-4df9f0590d8b req-0cab1857-8773-4fb9-9e9f-ccc66336e64a tempest-AttachVolumeTestJSON-2138545175 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66c939c7-8478-4180-8399-399799761ed0', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:14:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-d2481627-963a-4b0a-a8a1-91f252e5ef29 req-be0ec6ec-d296-42c2-b142-5e13cdda500b tempest-ServerActionsTestOtherA-723500123 None] attachment_update completed successfully. Sep 23 00:14:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-20abe32f-43b3-48e7-9f3a-4df9f0590d8b req-0cab1857-8773-4fb9-9e9f-ccc66336e64a tempest-AttachVolumeTestJSON-2138545175 None] attachment_update completed successfully. Sep 23 00:14:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:43 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf13a4a0-ee69-4fc7-b773-31f648bfbaa9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:43 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 Sep 23 00:14:43 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:44 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" returned: 0 in 0.617s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:44 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cf1ec3-59fc-4de2-9ffc-497c3cdb0e3d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:44 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 Sep 23 00:14:44 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:14:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:44 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:14:44 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:45 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" returned: 0 in 0.870s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.cf9f27b3-06d2-4113-8dd2-ac2c54a6a9cc98w2b_cr.img {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:45 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.cf9f27b3-06d2-4113-8dd2-ac2c54a6a9cc98w2b_cr.img Sep 23 00:14:45 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:45 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.682s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:14:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 8 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:14:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:14:47 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=26,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:53 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=33,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:58 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.cf9f27b3-06d2-4113-8dd2-ac2c54a6a9cc98w2b_cr.img" returned: 0 in 13.585s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:58 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d6a213-54d3-4d9d-bbd4-4f5da611f570]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:58 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 Sep 23 00:14:58 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:59 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" returned: 0 in 0.855s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:59 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8, size 1024.00 MB, duration 13.59 sec, destination /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.cf9f27b3-06d2-4113-8dd2-ac2c54a6a9cc98w2b_cr.img {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:14:59 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] Converted 1024.00 MB image at 75.37 MB/s Sep 23 00:14:59 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] cf9f27b3-06d2-4113-8dd2-ac2c54a6a9cc was raw, no need to convert to raw {{(pid=86481) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 00:15:08 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-57735e1c-a799-47b3-b087-b995694f495c req-8824f0a0-e3a4-4c96-8d21-b7fea740fe8f tempest-ServerActionsTestOtherA-723500123 None] Terminate volume connection completed successfully. Sep 23 00:15:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-57735e1c-a799-47b3-b087-b995694f495c req-8824f0a0-e3a4-4c96-8d21-b7fea740fe8f tempest-ServerActionsTestOtherA-723500123 None] Deleting attachment 4b1326a1-a29b-4463-8d4a-41ac9a94d927. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:15:18 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:18 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=2 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Flow 'volume_create_manager' (00d60c51-75fc-4f1d-875a-855d9291291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb96a1d-c9d1-4f08-b407-fb32a7f66f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb96a1d-c9d1-4f08-b407-fb32a7f66f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2015315616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821aa03e-8a79-448e-ae93-641023023066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2976120b56477e8e635442521a893e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:19Z,use_quota=True,user_id='fa9e8d80209846d895f87cdd0ee37077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f276c34a-7615-4d38-b874-b02df5d6972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f276c34a-7615-4d38-b874-b02df5d6972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd41cb9-5aa9-4925-8fd7-3c72814e27b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.image.glance [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Creating Keystone auth plugin from conf {{(pid=86481) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd41cb9-5aa9-4925-8fd7-3c72814e27b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '821aa03e-8a79-448e-ae93-641023023066', 'volume_name': 'volume-821aa03e-8a79-448e-ae93-641023023066', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6ff2f5-0aa6-4a44-9948-8d76444d7d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6ff2f5-0aa6-4a44-9948-8d76444d7d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe6e2a6-0b51-4e82-805a-ae39cac62ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:19 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Volume 821aa03e-8a79-448e-ae93-641023023066: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-821aa03e-8a79-448e-ae93-641023023066', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:15:19 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Trying to clone 821aa03e-8a79-448e-ae93-641023023066 from image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]). {{(pid=86481) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:15:20 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:15:20 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:15:20 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aedeb39-947a-4267-b9de-fdd2a5b64031]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:20 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD Sep 23 00:15:20 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:20 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:20 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Temporary image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 is fetched for user fa9e8d80209846d895f87cdd0ee37077. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:15:20 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eab2edd-775f-480b-93fa-27ed654d7568]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:21 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD Sep 23 00:15:21 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:21 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:30 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:30 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=3,cinder:INSERT=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:30 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-d3def090-45b2-4998-b271-092ea4495ec6 req-4f9eb654-d051-4a6d-a891-09838609de7f tempest-AttachVolumeTestJSON-2138545175 None] Terminate volume connection completed successfully. Sep 23 00:15:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-d3def090-45b2-4998-b271-092ea4495ec6 req-4f9eb654-d051-4a6d-a891-09838609de7f tempest-AttachVolumeTestJSON-2138545175 None] Deleting attachment 66c939c7-8478-4180-8399-399799761ed0. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 47.688s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] Uploaded volume to glance image-id: cf9f27b3-06d2-4113-8dd2-ac2c54a6a9cc. {{(pid=86481) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.999s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2015315616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821aa03e-8a79-448e-ae93-641023023066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d2976120b56477e8e635442521a893e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:19Z,use_quota=True,user_id='fa9e8d80209846d895f87cdd0ee37077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Creating volume 821aa03e-8a79-448e-ae93-641023023066 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:31 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:31 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 1073741824 Sep 23 00:15:31 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:31 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ece6644e-0952-4778-a1a5-5fb765418c70 tempest-VolumesActionsTest-423571339 None] Copy volume to image completed successfully. Sep 23 00:15:31 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 1073741824" returned: 0 in 0.559s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:31 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 Sep 23 00:15:31 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:32 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066" returned: 0 in 0.298s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:32 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Attempting download of 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}])) to volume 821aa03e-8a79-448e-ae93-641023023066. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:15:32 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44732da-95de-488c-8583-9acdffd30d9a]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_sqmx83i7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:32 devstack sudo[92401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_sqmx83i7 Sep 23 00:15:32 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:32 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_sqmx83i7" returned: 0 in 0.399s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_sqmx83i7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:32 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_sqmx83i7 Sep 23 00:15:32 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:33 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_sqmx83i7" returned: 1 in 0.404s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_sqmx83i7' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1070f8-d917-4fc3-aff7-51e173e2373a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:33 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD Sep 23 00:15:33 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7788b1a5-6f29-4cec-9c7a-4398169deb78]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:33 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 Sep 23 00:15:33 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:33 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 was qcow2, converting to qcow2 {{(pid=86481) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:33 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 Sep 23 00:15:33 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:33 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" returned: 0 in 0.497s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[67279b60-5fbc-4941-8dc4-f90b2836f2f4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:34 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 Sep 23 00:15:34 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:34 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" returned: 0 in 0.543s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:34 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img Sep 23 00:15:34 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:39 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Flow 'volume_create_manager' (9015af23-f0ae-45ac-ab28-d890479d626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffa081e-e3b8-45f6-8515-778718bfbfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffa081e-e3b8-45f6-8515-778718bfbfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1766320090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4c97a9-8f6a-45ec-b70f-99c91d21f253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bc4d3a8e6d4ed68c28b81e2334bcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:39Z,use_quota=True,user_id='236dc1a8a48b4cf1aa8687c2ac654e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bd8407-4476-4ebb-946e-b8f1037087c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bd8407-4476-4ebb-946e-b8f1037087c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e76520c-e10f-4cc7-b21f-9606aa88b99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e76520c-e10f-4cc7-b21f-9606aa88b99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff4c97a9-8f6a-45ec-b70f-99c91d21f253', 'volume_name': 'volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c9fcd8-67c3-49c1-8603-531d0ac0af71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c9fcd8-67c3-49c1-8603-531d0ac0af71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9372f1f0-15de-4f33-b40a-a977e84698a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:39 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Volume ff4c97a9-8f6a-45ec-b70f-99c91d21f253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253', 'volume_size': 1} Sep 23 00:15:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:40 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066" returned: 0 in 7.279s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:40 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wkzgb6dzdevstack@QuobyteHD, size 112.00 MB, duration 7.29 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:15:40 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Converted 112.00 MB image at 15.37 MB/s Sep 23 00:15:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:41 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 1G Sep 23 00:15:41 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:42 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 1G" returned: 0 in 1.226s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:42 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Downloaded image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}])) to volume 821aa03e-8a79-448e-ae93-641023023066 successfully. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:15:42 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Temporary image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 for user fa9e8d80209846d895f87cdd0ee37077 is deleted. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:15:42 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Marking volume 821aa03e-8a79-448e-ae93-641023023066 as bootable. {{(pid=86481) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:15:42 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Copying metadata from image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 to 821aa03e-8a79-448e-ae93-641023023066. {{(pid=86481) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:15:42 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Creating volume glance metadata for volume 821aa03e-8a79-448e-ae93-641023023066 backed by image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86481) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:15:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe6e2a6-0b51-4e82-805a-ae39cac62ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-821aa03e-8a79-448e-ae93-641023023066', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0edecde-3b09-42ba-802c-f052e7eb33ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:42 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Volume volume-821aa03e-8a79-448e-ae93-641023023066 (821aa03e-8a79-448e-ae93-641023023066): created successfully Sep 23 00:15:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0edecde-3b09-42ba-802c-f052e7eb33ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Flow 'volume_create_manager' (00d60c51-75fc-4f1d-875a-855d9291291d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:42 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-45cbb726-762b-4af6-9adf-fffbc7c31809 tempest-ServerActionsTestOtherA-723500123 None] Created volume successfully. Sep 23 00:15:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:15:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:44 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:15:44 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:45 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 1.021s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:15:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:15:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:15:46 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img" returned: 0 in 11.850s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:46 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[4960faa8-777a-47a2-bdfb-c8f2b810d3d9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:46 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 Sep 23 00:15:46 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:47 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" returned: 0 in 0.663s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:47 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8, size 1024.00 MB, duration 11.85 sec, destination /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:15:47 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Converted 1024.00 MB image at 86.40 MB/s Sep 23 00:15:47 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] 150cf2cb-692e-4117-a84f-5c46b6350858 was raw, converting to qcow2 {{(pid=86481) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 23 00:15:47 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38273fe-4cee-4f7c-be00-ed3eedec9895]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:47 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img Sep 23 00:15:47 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:47 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img" returned: 0 in 0.384s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:47 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img Sep 23 00:15:47 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:47 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img" returned: 1 in 0.510s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:15:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img /opt/stack/data/cinder/conversion/vol_upload_yog55pbs {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:47 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img /opt/stack/data/cinder/conversion/vol_upload_yog55pbs Sep 23 00:15:47 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:48 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img /opt/stack/data/cinder/conversion/vol_upload_yog55pbs" returned: 0 in 0.364s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:48 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Image conversion details: src /opt/stack/data/cinder/conversion/3735825c-bfd0-4d8d-aea1-80ffd67f3ef8.temp_image.150cf2cb-692e-4117-a84f-5c46b6350858rh1hr63r.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_yog55pbs {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:15:48 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 23 00:15:48 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[910d3b0e-9bb2-49dd-803c-44cf380b24ea]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_yog55pbs {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:48 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_yog55pbs Sep 23 00:15:48 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:48 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_yog55pbs" returned: 0 in 0.594s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-60a80f04-f2c5-481e-8b83-a133c9c22f81 req-061dde7d-4468-481b-8c0b-6cd0ae758cf8 tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 17.766s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Uploaded volume to glance image-id: 150cf2cb-692e-4117-a84f-5c46b6350858. {{(pid=86481) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.218s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1766320090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff4c97a9-8f6a-45ec-b70f-99c91d21f253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bc4d3a8e6d4ed68c28b81e2334bcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:39Z,use_quota=True,user_id='236dc1a8a48b4cf1aa8687c2ac654e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Creating volume ff4c97a9-8f6a-45ec-b70f-99c91d21f253 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:51 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:51 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253 1073741824 Sep 23 00:15:51 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:51 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-07ba0dd5-b6f8-4731-a950-c796c78d3f03 tempest-VolumesActionsTest-423571339 None] Copy volume to image completed successfully. Sep 23 00:15:51 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253 1073741824" returned: 0 in 0.652s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:51 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253 Sep 23 00:15:51 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:52 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253" returned: 0 in 0.420s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-60a80f04-f2c5-481e-8b83-a133c9c22f81 req-061dde7d-4468-481b-8c0b-6cd0ae758cf8 tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.185s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9372f1f0-15de-4f33-b40a-a977e84698a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7850926-3603-4ea5-a8b1-7f0c104cab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-60a80f04-f2c5-481e-8b83-a133c9c22f81 req-061dde7d-4468-481b-8c0b-6cd0ae758cf8 tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:52 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Volume volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253 (ff4c97a9-8f6a-45ec-b70f-99c91d21f253): created successfully Sep 23 00:15:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7850926-3603-4ea5-a8b1-7f0c104cab03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Flow 'volume_create_manager' (9015af23-f0ae-45ac-ab28-d890479d626d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:52 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d92624e9-47cf-499c-82d3-0d53279dd385 tempest-AttachVolumeNegativeTest-1985059259 None] Created volume successfully. Sep 23 00:15:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-60a80f04-f2c5-481e-8b83-a133c9c22f81 req-061dde7d-4468-481b-8c0b-6cd0ae758cf8 tempest-ServerActionsTestOtherA-723500123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-821aa03e-8a79-448e-ae93-641023023066', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '900416e3-1f72-4877-83e9-eaf1df5ebb09', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:15:52 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-60a80f04-f2c5-481e-8b83-a133c9c22f81 req-061dde7d-4468-481b-8c0b-6cd0ae758cf8 tempest-ServerActionsTestOtherA-723500123 None] attachment_update completed successfully. Sep 23 00:15:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Acquiring lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Acquiring lock "cinder-quobyte-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Lock "cinder-quobyte-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" acquired by "delete_volume" :: waited 0.046s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:53 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae14674-8647-484c-b859-91135c8bb336]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:53 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 Sep 23 00:15:53 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:53 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" returned: 0 in 0.683s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:54 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8 Sep 23 00:15:54 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:54 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" returned: 0 in 0.545s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Lock "cinder-quobyte-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8" released by "delete_volume" :: held 1.328s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Created reservations ['e048ea16-b239-4b57-bf59-5f0026ca7224', 'fccf5f6c-0887-4da0-aedf-81c055b507ef', '0ac5f68e-a76f-4d83-a8be-a9f47b5bb132', '82ecca3a-6faa-4055-8945-53ea0571fa58'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-cb314f65-ad0b-44ef-a97e-8536d50b217d req-a99aaabd-cf2d-4909-88ed-9965e546d66d tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-cb314f65-ad0b-44ef-a97e-8536d50b217d req-a99aaabd-cf2d-4909-88ed-9965e546d66d tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-cb314f65-ad0b-44ef-a97e-8536d50b217d req-a99aaabd-cf2d-4909-88ed-9965e546d66d tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:54 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:15:54 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-cb314f65-ad0b-44ef-a97e-8536d50b217d req-a99aaabd-cf2d-4909-88ed-9965e546d66d tempest-AttachVolumeNegativeTest-1985059259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74d83d38-f8d9-4fd6-a8c4-d1f73e77ccdd', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:15:55 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-cb314f65-ad0b-44ef-a97e-8536d50b217d req-a99aaabd-cf2d-4909-88ed-9965e546d66d tempest-AttachVolumeNegativeTest-1985059259 None] attachment_update completed successfully. Sep 23 00:15:55 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.536s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:55 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:55 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Deleted volume successfully. Sep 23 00:15:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9c8a018e-42a5-495a-bae4-57eec9fd62c7 tempest-VolumesActionsTest-423571339 None] Lock "cinder-3735825c-bfd0-4d8d-aea1-80ffd67f3ef8-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:05 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=37,cinder:UPDATE=17,cinder:INSERT=8 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:05 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=25,cinder:UPDATE=21,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-e1a4927a-777c-4abe-8bef-48eb7c46dcb1 req-50df1799-3f40-4677-a775-c42b97fb6f12 tempest-ServerActionsTestOtherA-723500123 None] Terminate volume connection completed successfully. Sep 23 00:16:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-e1a4927a-777c-4abe-8bef-48eb7c46dcb1 req-50df1799-3f40-4677-a775-c42b97fb6f12 tempest-ServerActionsTestOtherA-723500123 None] Deleting attachment 900416e3-1f72-4877-83e9-eaf1df5ebb09. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Flow 'volume_create_manager' (6d6ebd53-a3a7-439c-8c47-dc94aa890867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91692a5-ece6-4d42-b6c1-7b6ac99fc1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91692a5-ece6-4d42-b6c1-7b6ac99fc1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1344078109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e1f9b9-7296-4659-9470-fd666bf98b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c23a434c2a49469e99a33d1beba452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:21Z,use_quota=True,user_id='f5162211a2c14660af969bd7d100a3ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8896bd54-4249-43b2-9618-378f7504a414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8896bd54-4249-43b2-9618-378f7504a414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01d889b-e0a2-4ded-a079-b69cabdf0560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01d889b-e0a2-4ded-a079-b69cabdf0560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e1f9b9-7296-4659-9470-fd666bf98b0c', 'volume_name': 'volume-91e1f9b9-7296-4659-9470-fd666bf98b0c', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1994aec-9c64-4b08-86ca-be3dcc639021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1994aec-9c64-4b08-86ca-be3dcc639021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57851214-d6c3-49aa-bdd0-a4ddd382e9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Volume 91e1f9b9-7296-4659-9470-fd666bf98b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e1f9b9-7296-4659-9470-fd666bf98b0c', 'volume_size': 1} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1344078109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e1f9b9-7296-4659-9470-fd666bf98b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c23a434c2a49469e99a33d1beba452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:21Z,use_quota=True,user_id='f5162211a2c14660af969bd7d100a3ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Creating volume 91e1f9b9-7296-4659-9470-fd666bf98b0c {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:20 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:16:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91e1f9b9-7296-4659-9470-fd666bf98b0c 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:20 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91e1f9b9-7296-4659-9470-fd666bf98b0c 1073741824 Sep 23 00:16:20 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:21 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91e1f9b9-7296-4659-9470-fd666bf98b0c 1073741824" returned: 0 in 0.754s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91e1f9b9-7296-4659-9470-fd666bf98b0c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:21 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91e1f9b9-7296-4659-9470-fd666bf98b0c Sep 23 00:16:21 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-e1a4927a-777c-4abe-8bef-48eb7c46dcb1 req-a654b119-c90b-4aee-bcf9-37077d792e8c tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:22 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91e1f9b9-7296-4659-9470-fd666bf98b0c" returned: 0 in 0.593s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-e1a4927a-777c-4abe-8bef-48eb7c46dcb1 req-a654b119-c90b-4aee-bcf9-37077d792e8c tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.036s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:22 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57851214-d6c3-49aa-bdd0-a4ddd382e9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e1f9b9-7296-4659-9470-fd666bf98b0c', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:22 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02dcf24d-8236-4b56-b8f7-7bdfcb968e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-e1a4927a-777c-4abe-8bef-48eb7c46dcb1 req-a654b119-c90b-4aee-bcf9-37077d792e8c tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:22 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Volume volume-91e1f9b9-7296-4659-9470-fd666bf98b0c (91e1f9b9-7296-4659-9470-fd666bf98b0c): created successfully Sep 23 00:16:22 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02dcf24d-8236-4b56-b8f7-7bdfcb968e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:22 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Flow 'volume_create_manager' (6d6ebd53-a3a7-439c-8c47-dc94aa890867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:22 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c3cd4617-29c7-4e11-8bb0-3de1a81a64e9 tempest-VolumesNegativeTest-361364617 None] Created volume successfully. Sep 23 00:16:22 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-e1a4927a-777c-4abe-8bef-48eb7c46dcb1 req-a654b119-c90b-4aee-bcf9-37077d792e8c tempest-ServerActionsTestOtherA-723500123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-821aa03e-8a79-448e-ae93-641023023066', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '549d4c9f-1dad-4a5c-9347-f818d5f7aee0', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:16:22 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-e1a4927a-777c-4abe-8bef-48eb7c46dcb1 req-a654b119-c90b-4aee-bcf9-37077d792e8c tempest-ServerActionsTestOtherA-723500123 None] attachment_update completed successfully. Sep 23 00:16:32 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:32 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:16:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:44 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:16:44 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:45 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.687s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:16:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:16:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:16:54 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-d6a97920-0343-4a0b-bca9-7e39ebfbe88f req-60a0161e-9c6b-451e-b257-a199a5c4c0e9 tempest-AttachVolumeNegativeTest-1985059259 None] Terminate volume connection completed successfully. Sep 23 00:16:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-d6a97920-0343-4a0b-bca9-7e39ebfbe88f req-60a0161e-9c6b-451e-b257-a199a5c4c0e9 tempest-AttachVolumeNegativeTest-1985059259 None] Deleting attachment 74d83d38-f8d9-4fd6-a8c4-d1f73e77ccdd. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:17:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Acquiring lock "cinder-91e1f9b9-7296-4659-9470-fd666bf98b0c-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Lock "cinder-91e1f9b9-7296-4659-9470-fd666bf98b0c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Acquiring lock "cinder-quobyte-91e1f9b9-7296-4659-9470-fd666bf98b0c" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Lock "cinder-quobyte-91e1f9b9-7296-4659-9470-fd666bf98b0c" acquired by "delete_volume" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:01 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac28309b-cf92-4f6d-830c-e6da5b7c27ae]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91e1f9b9-7296-4659-9470-fd666bf98b0c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:01 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91e1f9b9-7296-4659-9470-fd666bf98b0c Sep 23 00:17:01 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:01 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91e1f9b9-7296-4659-9470-fd666bf98b0c" returned: 0 in 0.464s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91e1f9b9-7296-4659-9470-fd666bf98b0c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:01 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91e1f9b9-7296-4659-9470-fd666bf98b0c Sep 23 00:17:01 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:02 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91e1f9b9-7296-4659-9470-fd666bf98b0c" returned: 0 in 0.344s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Lock "cinder-quobyte-91e1f9b9-7296-4659-9470-fd666bf98b0c" released by "delete_volume" :: held 0.880s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:02 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Created reservations ['00380adb-c184-4ca4-8715-14d5306f9aac', 'b89378b5-510b-45f7-ad0c-61f03974afac', 'd5d88f84-442c-470e-89c3-2780fd3c1523', 'b8bdaf5a-9719-4da8-a972-6ce0139c1bd0'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:02 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:17:02 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:02 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.486s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:02 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:02 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Deleted volume successfully. Sep 23 00:17:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-42a9c798-940e-4cd6-9e9d-81b8c8e35f90 tempest-VolumesNegativeTest-361364617 None] Lock "cinder-91e1f9b9-7296-4659-9470-fd666bf98b0c-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-96e0363a-804b-4121-93af-862723110ad8 req-2d63975c-ab19-4d6d-821c-7af9c019db18 tempest-ServerActionsTestOtherA-723500123 None] Terminate volume connection completed successfully. Sep 23 00:17:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-96e0363a-804b-4121-93af-862723110ad8 req-2d63975c-ab19-4d6d-821c-7af9c019db18 tempest-ServerActionsTestOtherA-723500123 None] Deleting attachment 549d4c9f-1dad-4a5c-9347-f818d5f7aee0. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:17:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "cinder-821aa03e-8a79-448e-ae93-641023023066-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Lock "cinder-821aa03e-8a79-448e-ae93-641023023066-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "cinder-quobyte-821aa03e-8a79-448e-ae93-641023023066" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Lock "cinder-quobyte-821aa03e-8a79-448e-ae93-641023023066" acquired by "delete_volume" :: waited 0.040s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:06 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c1e465-3db6-4519-825f-87e86f33c8e7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:06 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 Sep 23 00:17:06 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:07 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066" returned: 0 in 0.880s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "cinder-b9be3428-a78e-4e5c-ba92-d528941610c0-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:07 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066 Sep 23 00:17:07 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Lock "cinder-b9be3428-a78e-4e5c-ba92-d528941610c0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "cinder-quobyte-b9be3428-a78e-4e5c-ba92-d528941610c0" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Lock "cinder-quobyte-b9be3428-a78e-4e5c-ba92-d528941610c0" acquired by "delete_volume" :: waited 0.057s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:07 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eeab2f2-dc83-4782-b939-39cf1709b4dc]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b9be3428-a78e-4e5c-ba92-d528941610c0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:07 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-821aa03e-8a79-448e-ae93-641023023066" returned: 0 in 0.366s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Lock "cinder-quobyte-821aa03e-8a79-448e-ae93-641023023066" released by "delete_volume" :: held 1.395s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:07 devstack cinder-volume[86481]: DEBUG cinder.quota [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Created reservations ['8134e7fd-00f2-4011-8577-821dfe254566', '868cb400-72aa-4219-888b-d01ce7187546', '11f2edab-8500-4834-b8a9-cc91de337847', '9574694c-8f58-4f78-8bca-dcedff6fc3fd'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:07 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b9be3428-a78e-4e5c-ba92-d528941610c0 Sep 23 00:17:07 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:08 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:17:08 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:08 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b9be3428-a78e-4e5c-ba92-d528941610c0" returned: 0 in 0.921s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b9be3428-a78e-4e5c-ba92-d528941610c0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:08 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b9be3428-a78e-4e5c-ba92-d528941610c0 Sep 23 00:17:08 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:08 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.597s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:08 devstack cinder-volume[86481]: DEBUG cinder.manager [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:08 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Deleted volume successfully. Sep 23 00:17:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-96e0363a-804b-4121-93af-862723110ad8 req-353150e4-55fc-40eb-ad32-440edf09b07c tempest-ServerActionsTestOtherA-723500123 None] Lock "cinder-821aa03e-8a79-448e-ae93-641023023066-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:09 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b9be3428-a78e-4e5c-ba92-d528941610c0" returned: 0 in 0.495s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Lock "cinder-quobyte-b9be3428-a78e-4e5c-ba92-d528941610c0" released by "delete_volume" :: held 1.509s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Created reservations ['66408944-3e3c-4aeb-90e3-3b2214d87e7d', '86419e99-8212-45a4-8ad6-37b05a7f2292', '4d207a1e-9d17-4597-8830-7b934cf66bf6', '68100adb-768b-4c46-88e4-7765db6ebaad'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:09 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:17:09 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Flow 'volume_create_manager' (4c663c7f-6d72-438e-b544-b6f90edf1d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72b3131-72ce-410d-87bc-7ab6716b854e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72b3131-72ce-410d-87bc-7ab6716b854e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-609129075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e6a5f3-a273-4a71-b094-328eecaaa853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d4f8daca642f3b274214280ef4ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:09Z,use_quota=True,user_id='ffa5e9acb2ee47a5bdd3fa82ad6b11a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fba473-b078-43b4-a5e8-036c1eb27657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37fba473-b078-43b4-a5e8-036c1eb27657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2600eeca-acde-47ab-90d2-f176b8c4b472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2600eeca-acde-47ab-90d2-f176b8c4b472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e6a5f3-a273-4a71-b094-328eecaaa853', 'volume_name': 'volume-e8e6a5f3-a273-4a71-b094-328eecaaa853', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d658ee-8986-4674-863d-648f7e714415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d658ee-8986-4674-863d-648f7e714415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d73b1b-3299-46c4-b61a-d40f2ac2cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:09 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Volume e8e6a5f3-a273-4a71-b094-328eecaaa853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e6a5f3-a273-4a71-b094-328eecaaa853', 'volume_size': 1} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-609129075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e6a5f3-a273-4a71-b094-328eecaaa853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d4f8daca642f3b274214280ef4ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:09Z,use_quota=True,user_id='ffa5e9acb2ee47a5bdd3fa82ad6b11a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Creating volume e8e6a5f3-a273-4a71-b094-328eecaaa853 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:09 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8e6a5f3-a273-4a71-b094-328eecaaa853 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:09 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8e6a5f3-a273-4a71-b094-328eecaaa853 1073741824 Sep 23 00:17:09 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:09 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.391s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:09 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Deleted volume successfully. Sep 23 00:17:09 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5550a9b7-9a30-4d5d-a6cb-b15a930f68f6 tempest-ServerActionsTestOtherA-723500123 None] Lock "cinder-b9be3428-a78e-4e5c-ba92-d528941610c0-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:10 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8e6a5f3-a273-4a71-b094-328eecaaa853 1073741824" returned: 0 in 1.118s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8e6a5f3-a273-4a71-b094-328eecaaa853 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:11 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8e6a5f3-a273-4a71-b094-328eecaaa853 Sep 23 00:17:11 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:11 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8e6a5f3-a273-4a71-b094-328eecaaa853" returned: 0 in 0.668s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d73b1b-3299-46c4-b61a-d40f2ac2cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e6a5f3-a273-4a71-b094-328eecaaa853', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e4437d-e2c7-4508-b820-99d42eb7cde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Volume volume-e8e6a5f3-a273-4a71-b094-328eecaaa853 (e8e6a5f3-a273-4a71-b094-328eecaaa853): created successfully Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e4437d-e2c7-4508-b820-99d42eb7cde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Flow 'volume_create_manager' (4c663c7f-6d72-438e-b544-b6f90edf1d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:11 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-852757f9-cbf0-4d3c-bd01-ea47f956769a tempest-AttachVolumeTestJSON-2138545175 None] Created volume successfully. Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Flow 'volume_create_manager' (2fedf321-530d-4815-b2c1-e5a0217058f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78649e9e-7655-4244-a5b9-c5e521fb723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78649e9e-7655-4244-a5b9-c5e521fb723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-517183048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd8062c-4719-41a2-9204-53be66983b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a396e31b011341958344a62c1165a75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:12Z,use_quota=True,user_id='94e4e82d42ce4dc48e08eeff45c0efca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3f9c51-a81f-4df9-85c6-67df459b11e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3f9c51-a81f-4df9-85c6-67df459b11e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0c96d5-7ba9-457e-a9a7-ea89b8d64e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0c96d5-7ba9-457e-a9a7-ea89b8d64e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd8062c-4719-41a2-9204-53be66983b83', 'volume_name': 'volume-1dd8062c-4719-41a2-9204-53be66983b83', 'volume_size': 2}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d9ad64-d245-4c91-80fa-87cfb378f64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d9ad64-d245-4c91-80fa-87cfb378f64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75ab9e8-6aa0-406a-a019-1c82b9cdab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Volume 1dd8062c-4719-41a2-9204-53be66983b83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd8062c-4719-41a2-9204-53be66983b83', 'volume_size': 2} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-517183048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd8062c-4719-41a2-9204-53be66983b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a396e31b011341958344a62c1165a75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:12Z,use_quota=True,user_id='94e4e82d42ce4dc48e08eeff45c0efca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Creating volume 1dd8062c-4719-41a2-9204-53be66983b83 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:11 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:17:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 2147483648 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:11 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 2147483648 Sep 23 00:17:12 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:13 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 2147483648" returned: 0 in 1.034s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:13 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 Sep 23 00:17:13 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:13 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83" returned: 0 in 0.452s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75ab9e8-6aa0-406a-a019-1c82b9cdab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd8062c-4719-41a2-9204-53be66983b83', 'volume_size': 2}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ce526e-e2d4-4dc8-9052-32a168cb7b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:13 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Volume volume-1dd8062c-4719-41a2-9204-53be66983b83 (1dd8062c-4719-41a2-9204-53be66983b83): created successfully Sep 23 00:17:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ce526e-e2d4-4dc8-9052-32a168cb7b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Flow 'volume_create_manager' (2fedf321-530d-4815-b2c1-e5a0217058f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:13 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1e9af246-a0ac-4c00-b15e-711b03ef7c9b tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Created volume successfully. Sep 23 00:17:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Creating offline snapshot 9bfd7813-bc07-4da3-be3c-6b9324886524 of volume 1dd8062c-4719-41a2-9204-53be66983b83 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:17:14 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4767e67-11aa-4174-a37f-a926110cfd3e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:14 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 Sep 23 00:17:14 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-038bcd05-4f78-4771-8101-a832d04ba6ec req-430beab5-cb08-455a-aa06-d5fbe22061fa tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:14 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83" returned: 0 in 0.573s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 2G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:14 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 2G Sep 23 00:17:14 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:15 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 2G" returned: 0 in 0.641s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd8062c-4719-41a2-9204-53be66983b83 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:15 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd8062c-4719-41a2-9204-53be66983b83 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 Sep 23 00:17:15 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:15 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd8062c-4719-41a2-9204-53be66983b83 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524" returned: 0 in 0.387s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:15 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 is being set with open permissions: ugo+rw Sep 23 00:17:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:15 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 Sep 23 00:17:15 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:16 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524" returned: 0 in 0.379s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:16 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.info Sep 23 00:17:16 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:16 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.info" returned: 0 in 0.357s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:16 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.info is being set with open permissions: ugo+rw Sep 23 00:17:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:16 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.info Sep 23 00:17:16 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:17 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.info" returned: 0 in 0.586s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.130s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-038bcd05-4f78-4771-8101-a832d04ba6ec req-430beab5-cb08-455a-aa06-d5fbe22061fa tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.744s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-038bcd05-4f78-4771-8101-a832d04ba6ec req-430beab5-cb08-455a-aa06-d5fbe22061fa tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c94023fe-fcac-41cc-8474-51a479d59e79 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Create snapshot completed successfully Sep 23 00:17:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-038bcd05-4f78-4771-8101-a832d04ba6ec req-430beab5-cb08-455a-aa06-d5fbe22061fa tempest-AttachVolumeTestJSON-2138545175 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-e8e6a5f3-a273-4a71-b094-328eecaaa853', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6be9d04-bdae-40a7-bf5a-5133f38b6d6e', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:17:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-038bcd05-4f78-4771-8101-a832d04ba6ec req-430beab5-cb08-455a-aa06-d5fbe22061fa tempest-AttachVolumeTestJSON-2138545175 None] attachment_update completed successfully. Sep 23 00:17:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Acquiring lock "cinder-9bfd7813-bc07-4da3-be3c-6b9324886524-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "cinder-9bfd7813-bc07-4da3-be3c-6b9324886524-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Acquiring lock "cinder-quobyte-1dd8062c-4719-41a2-9204-53be66983b83" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "cinder-quobyte-1dd8062c-4719-41a2-9204-53be66983b83" acquired by "delete_snapshot" :: waited 0.103s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Acquiring lock "cinder-quobyte-9bfd7813-bc07-4da3-be3c-6b9324886524" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "cinder-quobyte-9bfd7813-bc07-4da3-be3c-6b9324886524" acquired by "_delete_snapshot" :: waited 0.094s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Deleting offline snapshot 9bfd7813-bc07-4da3-be3c-6b9324886524 of volume 1dd8062c-4719-41a2-9204-53be66983b83 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:17:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] snapshot_file for this snap is: volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:17:18 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee79c5db-057e-427e-98d8-3e0b54f67b49]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:18 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 Sep 23 00:17:18 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:19 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524" returned: 0 in 0.789s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dd8062c-4719-41a2-9204-53be66983b83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:19 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d0ccc7-ba4a-449d-8fc8-32e0b3c3c0c4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:19 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 Sep 23 00:17:19 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:20 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83" returned: 0 in 0.955s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:20 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 Sep 23 00:17:20 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:20 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524" returned: 0 in 0.728s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:21 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524 Sep 23 00:17:21 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Flow 'volume_create_manager' (c02b752c-35fb-450e-9ecb-32378d8c00f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78eb030a-24c5-48ce-9ff3-780edbd7299a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78eb030a-24c5-48ce-9ff3-780edbd7299a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1904945862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47382e26-cb40-458a-87c6-b1b7d0209a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d4f8daca642f3b274214280ef4ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:21Z,use_quota=True,user_id='ffa5e9acb2ee47a5bdd3fa82ad6b11a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4e080f-de0c-409e-b9ee-cf67c5d7cd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4e080f-de0c-409e-b9ee-cf67c5d7cd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532caf17-fe99-4af5-9680-043eaa6f2090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532caf17-fe99-4af5-9680-043eaa6f2090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47382e26-cb40-458a-87c6-b1b7d0209a59', 'volume_name': 'volume-47382e26-cb40-458a-87c6-b1b7d0209a59', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577d1ff5-b5d7-4c68-be51-7fb1c031a8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577d1ff5-b5d7-4c68-be51-7fb1c031a8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c7d816-4cfc-41b1-afd9-6e2a67918bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:21 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Volume 47382e26-cb40-458a-87c6-b1b7d0209a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47382e26-cb40-458a-87c6-b1b7d0209a59', 'volume_size': 1} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1904945862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47382e26-cb40-458a-87c6-b1b7d0209a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa6d4f8daca642f3b274214280ef4ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:21Z,use_quota=True,user_id='ffa5e9acb2ee47a5bdd3fa82ad6b11a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Creating volume 47382e26-cb40-458a-87c6-b1b7d0209a59 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:21 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-47382e26-cb40-458a-87c6-b1b7d0209a59 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:21 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-47382e26-cb40-458a-87c6-b1b7d0209a59 1073741824 Sep 23 00:17:21 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:21 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83.9bfd7813-bc07-4da3-be3c-6b9324886524" returned: 0 in 0.867s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "cinder-quobyte-9bfd7813-bc07-4da3-be3c-6b9324886524" released by "_delete_snapshot" :: held 3.775s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "cinder-quobyte-1dd8062c-4719-41a2-9204-53be66983b83" released by "delete_snapshot" :: held 3.892s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:22 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Created reservations ['7bd72d71-9b51-478d-88db-e8c035dc7dac', '737ec17a-da63-4b8b-92d4-e8df48422d08', 'bfd8f3ae-e554-457a-b4d7-39b7a57fc860', 'f5a8ccc0-fc5a-4c4b-ba26-3bddddc10d07'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:22 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Delete snapshot completed successfully. Sep 23 00:17:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-321eb6d1-1514-49d8-91e3-8aec58e5a40c tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "cinder-9bfd7813-bc07-4da3-be3c-6b9324886524-delete_snapshot" released by "delete_snapshot" :: held 4.456s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Acquiring lock "cinder-1dd8062c-4719-41a2-9204-53be66983b83-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:22 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-47382e26-cb40-458a-87c6-b1b7d0209a59 1073741824" returned: 0 in 1.179s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "cinder-1dd8062c-4719-41a2-9204-53be66983b83-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-47382e26-cb40-458a-87c6-b1b7d0209a59 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Acquiring lock "cinder-quobyte-1dd8062c-4719-41a2-9204-53be66983b83" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:23 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-47382e26-cb40-458a-87c6-b1b7d0209a59 Sep 23 00:17:23 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "cinder-quobyte-1dd8062c-4719-41a2-9204-53be66983b83" acquired by "delete_volume" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:23 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda405ef-d1a9-43ea-a585-279f342de84c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:23 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 Sep 23 00:17:23 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:23 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-47382e26-cb40-458a-87c6-b1b7d0209a59" returned: 0 in 0.500s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c7d816-4cfc-41b1-afd9-6e2a67918bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47382e26-cb40-458a-87c6-b1b7d0209a59', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc86304-a082-44f2-8ddb-97b6fe553b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:23 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Volume volume-47382e26-cb40-458a-87c6-b1b7d0209a59 (47382e26-cb40-458a-87c6-b1b7d0209a59): created successfully Sep 23 00:17:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc86304-a082-44f2-8ddb-97b6fe553b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Flow 'volume_create_manager' (c02b752c-35fb-450e-9ecb-32378d8c00f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b85918f8-5303-4c96-8aac-45b66c9d30c6 tempest-AttachVolumeTestJSON-2138545175 None] Created volume successfully. Sep 23 00:17:23 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83" returned: 0 in 0.864s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:24 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83 Sep 23 00:17:24 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:24 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1dd8062c-4719-41a2-9204-53be66983b83" returned: 0 in 0.731s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "cinder-quobyte-1dd8062c-4719-41a2-9204-53be66983b83" released by "delete_volume" :: held 1.756s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:24 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Created reservations ['07554bf3-ef57-49b4-b1b2-61bf21f609f1', '73cfddcb-58d9-4584-9419-10cad57c560a', 'd8842388-0b2c-449d-b7e2-da9bb99eeabd', 'd6b3c331-d99c-494f-a4bf-0bfc7df96722'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:25 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:17:25 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-adffe9c1-c348-4b02-8445-cedd62eb28ed req-63ba5ca2-8818-4a2c-b00d-c2e71560caa4 tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-adffe9c1-c348-4b02-8445-cedd62eb28ed req-63ba5ca2-8818-4a2c-b00d-c2e71560caa4 tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-adffe9c1-c348-4b02-8445-cedd62eb28ed req-63ba5ca2-8818-4a2c-b00d-c2e71560caa4 tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-adffe9c1-c348-4b02-8445-cedd62eb28ed req-63ba5ca2-8818-4a2c-b00d-c2e71560caa4 tempest-AttachVolumeTestJSON-2138545175 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-47382e26-cb40-458a-87c6-b1b7d0209a59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e719460b-d547-4643-8480-8761da0b168a', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:17:25 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-adffe9c1-c348-4b02-8445-cedd62eb28ed req-63ba5ca2-8818-4a2c-b00d-c2e71560caa4 tempest-AttachVolumeTestJSON-2138545175 None] attachment_update completed successfully. Sep 23 00:17:25 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.561s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:25 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Deleted volume successfully. Sep 23 00:17:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8e1374b2-9e03-48c1-becd-7cfe326f9737 tempest-VolumesSnapshotNegativeTestJSON-899950962 None] Lock "cinder-1dd8062c-4719-41a2-9204-53be66983b83-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:29 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-28f65ab2-6da2-4c58-b677-b1752a9e8938 req-0687e0c0-a6e7-4c20-b672-3adf9390c91d tempest-AttachVolumeTestJSON-2138545175 None] Terminate volume connection completed successfully. Sep 23 00:17:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-28f65ab2-6da2-4c58-b677-b1752a9e8938 req-0687e0c0-a6e7-4c20-b672-3adf9390c91d tempest-AttachVolumeTestJSON-2138545175 None] Deleting attachment d6be9d04-bdae-40a7-bf5a-5133f38b6d6e. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:17:31 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-9bfc0a88-479d-4d18-8da7-a1019b31a8eb req-40544ed4-57e5-4a1f-909b-94492e9c707e tempest-AttachVolumeTestJSON-2138545175 None] Terminate volume connection completed successfully. Sep 23 00:17:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-9bfc0a88-479d-4d18-8da7-a1019b31a8eb req-40544ed4-57e5-4a1f-909b-94492e9c707e tempest-AttachVolumeTestJSON-2138545175 None] Deleting attachment e719460b-d547-4643-8480-8761da0b168a. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:17:39 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=54,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:41 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=51,cinder:UPDATE=56,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:17:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:44 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:17:44 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:45 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.450s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Flow 'volume_create_manager' (feaf75b1-1f4b-4d27-b00e-2c1edf7acb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f079663e-e49f-4625-86fb-aaef16b3f8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f079663e-e49f-4625-86fb-aaef16b3f8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1859592891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ead2abd-6fcb-43d9-84b2-3b235735533c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bc4d3a8e6d4ed68c28b81e2334bcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:46Z,use_quota=True,user_id='236dc1a8a48b4cf1aa8687c2ac654e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b0ee34-13a4-4176-a963-3056bcf240a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b0ee34-13a4-4176-a963-3056bcf240a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f865b8-92b2-41b7-83f7-764ceb87a669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f865b8-92b2-41b7-83f7-764ceb87a669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ead2abd-6fcb-43d9-84b2-3b235735533c', 'volume_name': 'volume-7ead2abd-6fcb-43d9-84b2-3b235735533c', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bf913c-aeeb-4f55-9f19-90e14dbb81ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bf913c-aeeb-4f55-9f19-90e14dbb81ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01776b87-e55b-470d-b099-0d9d69cd1155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:45 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Volume 7ead2abd-6fcb-43d9-84b2-3b235735533c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ead2abd-6fcb-43d9-84b2-3b235735533c', 'volume_size': 1} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1859592891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ead2abd-6fcb-43d9-84b2-3b235735533c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bc4d3a8e6d4ed68c28b81e2334bcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:46Z,use_quota=True,user_id='236dc1a8a48b4cf1aa8687c2ac654e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Creating volume 7ead2abd-6fcb-43d9-84b2-3b235735533c {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:45 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:17:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ead2abd-6fcb-43d9-84b2-3b235735533c 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:45 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ead2abd-6fcb-43d9-84b2-3b235735533c 1073741824 Sep 23 00:17:45 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:46 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ead2abd-6fcb-43d9-84b2-3b235735533c 1073741824" returned: 0 in 0.647s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ead2abd-6fcb-43d9-84b2-3b235735533c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:46 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ead2abd-6fcb-43d9-84b2-3b235735533c Sep 23 00:17:46 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:46 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ead2abd-6fcb-43d9-84b2-3b235735533c" returned: 0 in 0.360s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01776b87-e55b-470d-b099-0d9d69cd1155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ead2abd-6fcb-43d9-84b2-3b235735533c', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da873d8b-6a23-4f2d-9d0e-4bd8411b7150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:46 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Volume volume-7ead2abd-6fcb-43d9-84b2-3b235735533c (7ead2abd-6fcb-43d9-84b2-3b235735533c): created successfully Sep 23 00:17:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da873d8b-6a23-4f2d-9d0e-4bd8411b7150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Flow 'volume_create_manager' (feaf75b1-1f4b-4d27-b00e-2c1edf7acb83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:46 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ebcc16ec-d53a-48ae-9148-a31c68975335 tempest-AttachVolumeNegativeTest-1985059259 None] Created volume successfully. Sep 23 00:17:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-b04590f4-76af-4a01-9654-8d102f3718c7 req-f20de08d-d5ff-4218-9bfd-fecf37f037a9 tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-b04590f4-76af-4a01-9654-8d102f3718c7 req-f20de08d-d5ff-4218-9bfd-fecf37f037a9 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-b04590f4-76af-4a01-9654-8d102f3718c7 req-f20de08d-d5ff-4218-9bfd-fecf37f037a9 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-b04590f4-76af-4a01-9654-8d102f3718c7 req-f20de08d-d5ff-4218-9bfd-fecf37f037a9 tempest-AttachVolumeNegativeTest-1985059259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-7ead2abd-6fcb-43d9-84b2-3b235735533c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a58cd67e-c621-43cc-9f9f-cb8cd07ddd35', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:17:49 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-b04590f4-76af-4a01-9654-8d102f3718c7 req-f20de08d-d5ff-4218-9bfd-fecf37f037a9 tempest-AttachVolumeNegativeTest-1985059259 None] attachment_update completed successfully. Sep 23 00:17:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "cinder-47382e26-cb40-458a-87c6-b1b7d0209a59-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Lock "cinder-47382e26-cb40-458a-87c6-b1b7d0209a59-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "cinder-quobyte-47382e26-cb40-458a-87c6-b1b7d0209a59" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Lock "cinder-quobyte-47382e26-cb40-458a-87c6-b1b7d0209a59" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:49 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9149444c-d60d-4309-91aa-7271655325b4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-47382e26-cb40-458a-87c6-b1b7d0209a59 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:50 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-47382e26-cb40-458a-87c6-b1b7d0209a59 Sep 23 00:17:50 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:50 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-47382e26-cb40-458a-87c6-b1b7d0209a59" returned: 0 in 0.760s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-47382e26-cb40-458a-87c6-b1b7d0209a59 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:50 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-47382e26-cb40-458a-87c6-b1b7d0209a59 Sep 23 00:17:50 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:51 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-47382e26-cb40-458a-87c6-b1b7d0209a59" returned: 0 in 0.507s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Lock "cinder-quobyte-47382e26-cb40-458a-87c6-b1b7d0209a59" released by "delete_volume" :: held 1.366s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:51 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Created reservations ['47d7d1ce-277e-49d3-9a20-54574cc52736', '10d4d147-e805-4c08-835f-d1acf5b10b09', '6307a239-e762-4207-b38e-02eb77494a81', 'f64a0eef-7ad6-4b67-8008-2fdeca330d99'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:51 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:17:51 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:51 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.461s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:51 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:51 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Deleted volume successfully. Sep 23 00:17:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-670b6475-1f4b-44b4-838a-a4a560c4e15c tempest-AttachVolumeTestJSON-2138545175 None] Lock "cinder-47382e26-cb40-458a-87c6-b1b7d0209a59-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "cinder-e8e6a5f3-a273-4a71-b094-328eecaaa853-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Lock "cinder-e8e6a5f3-a273-4a71-b094-328eecaaa853-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "cinder-quobyte-e8e6a5f3-a273-4a71-b094-328eecaaa853" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Lock "cinder-quobyte-e8e6a5f3-a273-4a71-b094-328eecaaa853" acquired by "delete_volume" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:52 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[253853ce-6aa4-4e03-a5e3-6661465afee1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8e6a5f3-a273-4a71-b094-328eecaaa853 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:52 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8e6a5f3-a273-4a71-b094-328eecaaa853 Sep 23 00:17:52 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:52 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-48dc6895-9bdc-4c21-9dde-3c0e0d8c255d req-bc52e81b-ff07-4652-8e96-023e4912aeec tempest-AttachVolumeNegativeTest-1985059259 None] Terminate volume connection completed successfully. Sep 23 00:17:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-48dc6895-9bdc-4c21-9dde-3c0e0d8c255d req-bc52e81b-ff07-4652-8e96-023e4912aeec tempest-AttachVolumeNegativeTest-1985059259 None] Deleting attachment a58cd67e-c621-43cc-9f9f-cb8cd07ddd35. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:17:53 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8e6a5f3-a273-4a71-b094-328eecaaa853" returned: 0 in 0.750s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8e6a5f3-a273-4a71-b094-328eecaaa853 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:53 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8e6a5f3-a273-4a71-b094-328eecaaa853 Sep 23 00:17:53 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:53 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8e6a5f3-a273-4a71-b094-328eecaaa853" returned: 0 in 0.392s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Lock "cinder-quobyte-e8e6a5f3-a273-4a71-b094-328eecaaa853" released by "delete_volume" :: held 1.245s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:53 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Created reservations ['abce0f96-6228-4dcb-8bcf-2278868d76db', '2648e0c4-f354-4d3e-a295-510d2cb32d6e', '295c6ca7-c9ce-436e-abcd-ef28946e32f6', '0ae5d364-e00a-4bb6-b53f-9404c7d73bcb'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:54 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:17:54 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:54 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.782s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:54 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:54 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Deleted volume successfully. Sep 23 00:17:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b7fade09-94c6-4ba1-8465-fbbd1c936c0d tempest-AttachVolumeTestJSON-2138545175 None] Lock "cinder-e8e6a5f3-a273-4a71-b094-328eecaaa853-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "cinder-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Lock "cinder-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "cinder-quobyte-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Lock "cinder-quobyte-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:55 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69a4e48-a373-4ec0-85e4-f85f68cc1d86]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:55 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3 Sep 23 00:17:55 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:55 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3" returned: 0 in 0.609s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:55 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3 Sep 23 00:17:55 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:56 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3" returned: 0 in 0.495s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Lock "cinder-quobyte-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3" released by "delete_volume" :: held 1.197s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:56 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Created reservations ['28c84ae5-6c8d-447b-b3d5-e4e492d22771', '10fcbff9-42b3-4c88-a645-c5157859cf4b', '76cae704-b13f-438f-928f-2b4bb4b59a8d', '2ba85359-db09-40dc-a1c3-b0620a0c0302'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:17:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:56 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:17:56 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:56 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.365s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:56 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:56 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Deleted volume successfully. Sep 23 00:17:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-47fd1104-c6ae-4bd4-9b44-7dc48919296b tempest-AttachVolumeTestJSON-2138545175 None] Lock "cinder-f4d4f867-552f-4b9e-8c2d-8bd0ad856ca3-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:06 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=24,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:18:06 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=28,cinder:SELECT=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Flow 'volume_create_manager' (0d2b7b85-5b86-4beb-ae72-2b32b30f16aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6521a7-d6dd-4ee0-bea8-54c24cb944c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6521a7-d6dd-4ee0-bea8-54c24cb944c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1325540975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e424fc50-43fb-4ac6-bb73-42d03cb9ca9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70aae39d45b948dbb222d7204a2d236d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:38Z,use_quota=True,user_id='73ec2ef625a44b6582d6f9e4902edfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3107a85e-be53-4ac5-b020-3ff196a28d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3107a85e-be53-4ac5-b020-3ff196a28d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e23fac7-c3e1-4f1f-b7bc-9b66f57e182c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e23fac7-c3e1-4f1f-b7bc-9b66f57e182c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e424fc50-43fb-4ac6-bb73-42d03cb9ca9b', 'volume_name': 'volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d349b421-acb7-483f-902b-7826628bcb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d349b421-acb7-483f-902b-7826628bcb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e325f3f-39be-4ad5-8018-e0e12f2cccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Volume e424fc50-43fb-4ac6-bb73-42d03cb9ca9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b', 'volume_size': 1} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1325540975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e424fc50-43fb-4ac6-bb73-42d03cb9ca9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70aae39d45b948dbb222d7204a2d236d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:38Z,use_quota=True,user_id='73ec2ef625a44b6582d6f9e4902edfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Creating volume e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:38 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:18:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:38 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b 1073741824 Sep 23 00:18:38 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:39 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b 1073741824" returned: 0 in 0.924s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:39 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b Sep 23 00:18:39 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:40 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" returned: 0 in 0.881s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e325f3f-39be-4ad5-8018-e0e12f2cccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b28de9-b207-4c33-ab04-2ded243f512d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:40 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Volume volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b (e424fc50-43fb-4ac6-bb73-42d03cb9ca9b): created successfully Sep 23 00:18:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b28de9-b207-4c33-ab04-2ded243f512d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Flow 'volume_create_manager' (0d2b7b85-5b86-4beb-ae72-2b32b30f16aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:40 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f9afcc9b-ed3c-4e47-b588-69c18a326b00 tempest-SnapshotsActionsTest-131396959 None] Created volume successfully. Sep 23 00:18:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] Creating offline snapshot 7d3f78d0-67ac-4686-a80a-047807c224e8 of volume e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:18:42 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3c210a-c70c-4ad2-b9bd-865afb44b6b9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:43 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b Sep 23 00:18:43 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:43 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" returned: 0 in 0.749s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:43 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 1G Sep 23 00:18:43 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:44 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 1G" returned: 0 in 0.876s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:44 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:18:44 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Flow 'volume_create_manager' (2a834e9e-2a90-4047-b9ba-82ea9735505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7940d264-ec7b-40c1-ac20-5b63e47469ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7940d264-ec7b-40c1-ac20-5b63e47469ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1512744396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eba23238d8a4e72b11cba4da391aa4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:45Z,use_quota=True,user_id='47eaccf0f5b846de93d028f612260347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce760a53-2b24-46eb-ad91-fc3140423ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce760a53-2b24-46eb-ad91-fc3140423ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09da0e51-b734-47e7-83f9-c089a33e8584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09da0e51-b734-47e7-83f9-c089a33e8584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f', 'volume_name': 'volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5675c605-fbde-4bcf-a266-9b2d9f0ac9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5675c605-fbde-4bcf-a266-9b2d9f0ac9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e10a288-bd1f-429f-93f9-43489df94bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:44 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Volume f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f', 'volume_size': 1} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:45 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:18:45 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:45 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.763s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:45 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 is being set with open permissions: ugo+rw Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:45 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:18:45 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Flow 'volume_create_manager' (90235297-fc01-4243-b009-15597df1334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583e3f19-d34e-4a85-badf-ea8474f89d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:45 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.653s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583e3f19-d34e-4a85-badf-ea8474f89d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-909306243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf299f93-e541-4c6b-b3b5-a8b1039668cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39fbb4b0b922422789339819eb91524b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:45Z,use_quota=True,user_id='2f5ccbf0ae9441dc8a6cf72a34a91010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7aa20ea-b060-4b39-b162-e4a849148438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7aa20ea-b060-4b39-b162-e4a849148438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f876f3-b577-4d37-85a7-8b269ab3e068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f876f3-b577-4d37-85a7-8b269ab3e068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf299f93-e541-4c6b-b3b5-a8b1039668cb', 'volume_name': 'volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dd8838-a93b-4a14-aa80-071795c37b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dd8838-a93b-4a14-aa80-071795c37b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4412e2c-0e08-4741-b1a3-bbf43e7d16c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:45 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Volume bf299f93-e541-4c6b-b3b5-a8b1039668cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb', 'volume_size': 1} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:18:45 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.460s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:45 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.info Sep 23 00:18:45 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:46 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.info" returned: 0 in 0.339s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:46 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.info is being set with open permissions: ugo+rw Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:46 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.info Sep 23 00:18:46 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:46 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.info" returned: 0 in 0.383s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.763s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.597s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1512744396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eba23238d8a4e72b11cba4da391aa4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:45Z,use_quota=True,user_id='47eaccf0f5b846de93d028f612260347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Creating volume f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:46 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:18:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:46 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f 1073741824 Sep 23 00:18:46 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:46 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b5a936c1-23b0-4368-a4b0-8132bd73f0a8 tempest-SnapshotsActionsTest-131396959 None] Create snapshot completed successfully Sep 23 00:18:47 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f 1073741824" returned: 0 in 0.676s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:47 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f Sep 23 00:18:47 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:47 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f" returned: 0 in 0.355s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.959s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-909306243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf299f93-e541-4c6b-b3b5-a8b1039668cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39fbb4b0b922422789339819eb91524b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:45Z,use_quota=True,user_id='2f5ccbf0ae9441dc8a6cf72a34a91010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Creating volume bf299f93-e541-4c6b-b3b5-a8b1039668cb {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:47 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:47 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb 1073741824 Sep 23 00:18:47 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e10a288-bd1f-429f-93f9-43489df94bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9b709d-1c31-4f16-839f-a38e003505a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:47 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Volume volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f (f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f): created successfully Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9b709d-1c31-4f16-839f-a38e003505a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Flow 'volume_create_manager' (2a834e9e-2a90-4047-b9ba-82ea9735505f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:47 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-435c9a45-bffd-4104-aadd-f1a7d90710e7 tempest-TestMinimumBasicScenario-2039131119 None] Created volume successfully. Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:48 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb 1073741824" returned: 0 in 0.725s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:48 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb Sep 23 00:18:48 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:48 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb" returned: 0 in 0.355s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.780s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] Creating offline snapshot ddd94470-a505-42cd-addf-9406979068cb of volume e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4412e2c-0e08-4741-b1a3-bbf43e7d16c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dba0b25-8898-4bc5-a26b-d690a85419a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f13475-7227-4c22-94c0-42bbd884f08f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:48 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Volume volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb (bf299f93-e541-4c6b-b3b5-a8b1039668cb): created successfully Sep 23 00:18:48 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dba0b25-8898-4bc5-a26b-d690a85419a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Flow 'volume_create_manager' (90235297-fc01-4243-b009-15597df1334a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:49 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-36998bf0-50a9-4afa-8ac1-c080105e28da tempest-ServersNegativeTestJSON-156986321 None] Created volume successfully. Sep 23 00:18:49 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:18:49 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:49 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.649s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:49 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb 1G Sep 23 00:18:49 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:50 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb 1G" returned: 0 in 0.966s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:50 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb Sep 23 00:18:50 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-e9fd472d-0659-479e-ab13-ecaf35afaf76 req-37b58620-3bbd-4861-be95-88db94923c90 tempest-TestMinimumBasicScenario-2039131119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:51 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb" returned: 0 in 0.429s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:51 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb is being set with open permissions: ugo+rw Sep 23 00:18:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:51 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb Sep 23 00:18:51 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:51 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb" returned: 0 in 0.300s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.551s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-e9fd472d-0659-479e-ab13-ecaf35afaf76 req-37b58620-3bbd-4861-be95-88db94923c90 tempest-TestMinimumBasicScenario-2039131119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.688s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-e9fd472d-0659-479e-ab13-ecaf35afaf76 req-37b58620-3bbd-4861-be95-88db94923c90 tempest-TestMinimumBasicScenario-2039131119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:51 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-86afacc6-094a-44e5-bd5c-b33a79876c2b tempest-SnapshotsActionsTest-131396959 None] Create snapshot completed successfully Sep 23 00:18:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-e9fd472d-0659-479e-ab13-ecaf35afaf76 req-37b58620-3bbd-4861-be95-88db94923c90 tempest-TestMinimumBasicScenario-2039131119 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9584641-613b-4dee-81a9-3039ef6d72da', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:18:51 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-e9fd472d-0659-479e-ab13-ecaf35afaf76 req-37b58620-3bbd-4861-be95-88db94923c90 tempest-TestMinimumBasicScenario-2039131119 None] attachment_update completed successfully. Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Flow 'volume_create_manager' (e3aaedef-0c25-4902-ace9-73cec4b2ed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e8bded-d4b3-44cf-a777-d4dc7c305bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e8bded-d4b3-44cf-a777-d4dc7c305bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1386131864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e55acb-9937-49e3-9dc5-34e58c9b3f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39fbb4b0b922422789339819eb91524b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:52Z,use_quota=True,user_id='2f5ccbf0ae9441dc8a6cf72a34a91010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7fb49a-2002-4b2b-bf9e-eb2c074f29e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7fb49a-2002-4b2b-bf9e-eb2c074f29e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dca4d77-07e0-41ef-84f0-9347c106c2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dca4d77-07e0-41ef-84f0-9347c106c2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8e55acb-9937-49e3-9dc5-34e58c9b3f03', 'volume_name': 'volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1f8663-58de-4e84-9b5f-f5a5cbc4e3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1f8663-58de-4e84-9b5f-f5a5cbc4e3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65953db-b2b7-4515-9729-e4e125b84022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:52 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Volume f8e55acb-9937-49e3-9dc5-34e58c9b3f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03', 'volume_size': 1} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1386131864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e55acb-9937-49e3-9dc5-34e58c9b3f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39fbb4b0b922422789339819eb91524b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:52Z,use_quota=True,user_id='2f5ccbf0ae9441dc8a6cf72a34a91010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Creating volume f8e55acb-9937-49e3-9dc5-34e58c9b3f03 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:52 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:52 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03 1073741824 Sep 23 00:18:52 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Acquiring lock "cinder-ddd94470-a505-42cd-addf-9406979068cb-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-ddd94470-a505-42cd-addf-9406979068cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Acquiring lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Acquiring lock "cinder-quobyte-ddd94470-a505-42cd-addf-9406979068cb" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-ddd94470-a505-42cd-addf-9406979068cb" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Deleting offline snapshot ddd94470-a505-42cd-addf-9406979068cb of volume e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] snapshot_file for this snap is: volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeeb46c-addd-40a0-a812-a5f067996619]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:52 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03 1073741824" returned: 0 in 0.796s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:52 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb Sep 23 00:18:53 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:53 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03 Sep 23 00:18:53 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:53 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb" returned: 0 in 0.579s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:53 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03" returned: 0 in 0.347s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65953db-b2b7-4515-9729-e4e125b84022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e6b2d0-deaa-40c1-bb8c-78d31cb728ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31bc4b5-8b98-4143-9a6c-706963cf3e56]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:53 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Volume volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03 (f8e55acb-9937-49e3-9dc5-34e58c9b3f03): created successfully Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e6b2d0-deaa-40c1-bb8c-78d31cb728ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Flow 'volume_create_manager' (e3aaedef-0c25-4902-ace9-73cec4b2ed0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:53 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a48c221a-10f2-4434-a994-2434781673bd tempest-ServersNegativeTestJSON-156986321 None] Created volume successfully. Sep 23 00:18:53 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:18:53 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:53 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.524s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:53 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb Sep 23 00:18:53 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:54 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb" returned: 0 in 0.600s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:54 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb Sep 23 00:18:54 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Acquiring lock "cinder-f8e55acb-9937-49e3-9dc5-34e58c9b3f03-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Lock "cinder-f8e55acb-9937-49e3-9dc5-34e58c9b3f03-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:54 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.ddd94470-a505-42cd-addf-9406979068cb" returned: 0 in 0.417s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-ddd94470-a505-42cd-addf-9406979068cb" released by "_delete_snapshot" :: held 2.304s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Acquiring lock "cinder-quobyte-f8e55acb-9937-49e3-9dc5-34e58c9b3f03" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" released by "delete_snapshot" :: held 2.354s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Lock "cinder-quobyte-f8e55acb-9937-49e3-9dc5-34e58c9b3f03" acquired by "delete_volume" :: waited 0.036s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:55 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ba7f80-a334-45f8-83d7-c1969b651361]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:55 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Created reservations ['b6e17684-7e70-420d-bcb6-5aa6005eb395', 'afabcaea-a9e7-4e68-a5e2-c280171adeed', 'abae1636-5948-4ca5-9b21-994e4f1a65e9', '5762e572-9ecf-4b96-84f1-f595651c6bf5'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:55 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03 Sep 23 00:18:55 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:55 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Delete snapshot completed successfully. Sep 23 00:18:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6ecbc9f-7acc-43a2-a078-dbc586c22290 tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-ddd94470-a505-42cd-addf-9406979068cb-delete_snapshot" released by "delete_snapshot" :: held 2.625s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:55 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03" returned: 0 in 0.486s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:55 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03 Sep 23 00:18:55 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:55 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8e55acb-9937-49e3-9dc5-34e58c9b3f03" returned: 0 in 0.339s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Lock "cinder-quobyte-f8e55acb-9937-49e3-9dc5-34e58c9b3f03" released by "delete_volume" :: held 0.892s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Created reservations ['3a31b6b3-02b7-48b6-a992-6f2aa12198c1', '76e60487-735d-4320-9311-f663bf55550c', '86a6f947-a043-4721-8345-6466e16f3935', '1024873b-3ab6-440e-b980-f8a6d6c56d78'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:56 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:18:56 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] Creating offline snapshot 73916eba-bac0-49a2-b4de-a90c13976d22 of volume e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:18:56 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.403s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:56 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Deleted volume successfully. Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[462de246-b818-468f-85cd-65ac7ee328d9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-34d9c272-7d11-42c8-a54c-3c6b4feece38 tempest-ServersNegativeTestJSON-156986321 None] Lock "cinder-f8e55acb-9937-49e3-9dc5-34e58c9b3f03-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:56 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:18:56 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:57 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.517s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:57 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 1G Sep 23 00:18:57 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Acquiring lock "cinder-bf299f93-e541-4c6b-b3b5-a8b1039668cb-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Lock "cinder-bf299f93-e541-4c6b-b3b5-a8b1039668cb-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Acquiring lock "cinder-quobyte-bf299f93-e541-4c6b-b3b5-a8b1039668cb" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Lock "cinder-quobyte-bf299f93-e541-4c6b-b3b5-a8b1039668cb" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:57 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[796bddcf-61c7-4023-a005-641a8c320021]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:57 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb Sep 23 00:18:57 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:57 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 1G" returned: 0 in 0.588s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:57 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 Sep 23 00:18:57 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:58 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb" returned: 0 in 0.660s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:58 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:58 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb Sep 23 00:18:58 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22" returned: 0 in 0.423s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:58 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 is being set with open permissions: ugo+rw Sep 23 00:18:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:58 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 Sep 23 00:18:58 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:58 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22" returned: 0 in 0.320s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:58 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf299f93-e541-4c6b-b3b5-a8b1039668cb" returned: 0 in 0.442s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Lock "cinder-quobyte-bf299f93-e541-4c6b-b3b5-a8b1039668cb" released by "delete_volume" :: held 1.198s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:58 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1461504a-fc70-4573-8d65-ff6ca7aeaf94 tempest-SnapshotsActionsTest-131396959 None] Create snapshot completed successfully Sep 23 00:18:58 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Created reservations ['190adc68-134f-4580-a936-eb6ed7622525', 'e357738c-f2fc-45fc-8efa-f7de0591b019', 'd7763022-1cf2-4f35-8295-5c1747ed9be6', '65bdb14f-c300-4df9-b5a9-f38881ebd315'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:18:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:59 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:18:59 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:59 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.511s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:59 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Deleted volume successfully. Sep 23 00:18:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-41947548-17e6-45ba-a90b-3280036b0f81 tempest-ServersNegativeTestJSON-156986321 None] Lock "cinder-bf299f93-e541-4c6b-b3b5-a8b1039668cb-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Acquiring lock "cinder-73916eba-bac0-49a2-b4de-a90c13976d22-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-73916eba-bac0-49a2-b4de-a90c13976d22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Acquiring lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Acquiring lock "cinder-quobyte-73916eba-bac0-49a2-b4de-a90c13976d22" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-73916eba-bac0-49a2-b4de-a90c13976d22" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Deleting offline snapshot 73916eba-bac0-49a2-b4de-a90c13976d22 of volume e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] snapshot_file for this snap is: volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:00 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fc705d-e6fa-4e51-90db-32b49f1308a5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:00 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 Sep 23 00:19:00 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:01 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22" returned: 0 in 0.812s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:01 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[176cadcc-fb5d-4839-8ce7-d9017dc5281b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:01 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:19:01 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:01 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.619s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:01 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 Sep 23 00:19:01 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:02 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22" returned: 0 in 1.003s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:02 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22 Sep 23 00:19:02 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:02 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Flow 'volume_create_manager' (0c32446f-c9e5-4a2d-966d-76630d57386e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d2a601-90e0-4a75-b646-127ccbe75932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d2a601-90e0-4a75-b646-127ccbe75932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1360036965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e222d0-ec99-40dc-af5a-d4c51a64d02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bc4d3a8e6d4ed68c28b81e2334bcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:03Z,use_quota=True,user_id='236dc1a8a48b4cf1aa8687c2ac654e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a259ad34-2936-43fc-9c93-36ef2e152ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a259ad34-2936-43fc-9c93-36ef2e152ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0122e7-4522-4380-91d6-7cf3b4b7e137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0122e7-4522-4380-91d6-7cf3b4b7e137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29e222d0-ec99-40dc-af5a-d4c51a64d02f', 'volume_name': 'volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0941ed-d869-44d8-876a-63dd84509014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0941ed-d869-44d8-876a-63dd84509014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18751b42-ea06-48f5-ab22-bd68d1891142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:03 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Volume 29e222d0-ec99-40dc-af5a-d4c51a64d02f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f', 'volume_size': 1} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1360036965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29e222d0-ec99-40dc-af5a-d4c51a64d02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bc4d3a8e6d4ed68c28b81e2334bcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:03Z,use_quota=True,user_id='236dc1a8a48b4cf1aa8687c2ac654e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Creating volume 29e222d0-ec99-40dc-af5a-d4c51a64d02f {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:03 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:03 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.73916eba-bac0-49a2-b4de-a90c13976d22" returned: 0 in 0.526s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:03 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f 1073741824 Sep 23 00:19:03 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-73916eba-bac0-49a2-b4de-a90c13976d22" released by "_delete_snapshot" :: held 3.209s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" released by "delete_snapshot" :: held 3.252s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Created reservations ['6109808e-0468-4b59-9e16-b8499776b9f1', '15d62a2a-c9bf-4223-ab72-e405dd8873db', 'f676c752-479b-4b8a-aabe-6f1a991480fd', '5844a6c2-8a1f-49eb-9d51-f30b91e60fa0'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:03 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Delete snapshot completed successfully. Sep 23 00:19:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe110044-7938-494d-9216-b8d3f6a12ca0 tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-73916eba-bac0-49a2-b4de-a90c13976d22-delete_snapshot" released by "delete_snapshot" :: held 3.605s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:04 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f 1073741824" returned: 0 in 0.908s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:04 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f Sep 23 00:19:04 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:04 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f" returned: 0 in 0.403s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18751b42-ea06-48f5-ab22-bd68d1891142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c32de1-c407-42f1-bb91-dfef9c7f116c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:04 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Volume volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f (29e222d0-ec99-40dc-af5a-d4c51a64d02f): created successfully Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c32de1-c407-42f1-bb91-dfef9c7f116c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Flow 'volume_create_manager' (0c32446f-c9e5-4a2d-966d-76630d57386e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:04 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b0660a98-8d9c-4bb6-b1b0-e4c1aa6f0b79 tempest-AttachVolumeNegativeTest-1985059259 None] Created volume successfully. Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] Creating offline snapshot 93ad2614-3cc5-45a3-953e-7a2024c4796d of volume e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe08fb97-ae0d-416b-8733-16e0e53c3bd1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:05 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:19:05 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:05 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.480s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:05 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d 1G Sep 23 00:19:05 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:06 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d 1G" returned: 0 in 0.938s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:06 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d Sep 23 00:19:06 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:07 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d" returned: 0 in 0.613s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:07 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d is being set with open permissions: ugo+rw Sep 23 00:19:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:07 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d Sep 23 00:19:07 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-db36da4c-945a-412e-a0f7-4788494223f0 req-e82cf8cf-33fa-40b5-bb29-2204df6593ee tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:07 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d" returned: 0 in 0.397s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-db36da4c-945a-412e-a0f7-4788494223f0 req-e82cf8cf-33fa-40b5-bb29-2204df6593ee tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.374s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-db36da4c-945a-412e-a0f7-4788494223f0 req-e82cf8cf-33fa-40b5-bb29-2204df6593ee tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:07 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-45abe150-14aa-4945-a9f2-1122c0924c56 tempest-SnapshotsActionsTest-131396959 None] Create snapshot completed successfully Sep 23 00:19:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-db36da4c-945a-412e-a0f7-4788494223f0 req-e82cf8cf-33fa-40b5-bb29-2204df6593ee tempest-AttachVolumeNegativeTest-1985059259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '189b41b5-f346-49fd-8d28-26857dd0822b', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:19:07 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-db36da4c-945a-412e-a0f7-4788494223f0 req-e82cf8cf-33fa-40b5-bb29-2204df6593ee tempest-AttachVolumeNegativeTest-1985059259 None] attachment_update completed successfully. Sep 23 00:19:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Acquiring lock "cinder-93ad2614-3cc5-45a3-953e-7a2024c4796d-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-93ad2614-3cc5-45a3-953e-7a2024c4796d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.119s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Acquiring lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Acquiring lock "cinder-quobyte-93ad2614-3cc5-45a3-953e-7a2024c4796d" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-93ad2614-3cc5-45a3-953e-7a2024c4796d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Deleting offline snapshot 93ad2614-3cc5-45a3-953e-7a2024c4796d of volume e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] snapshot_file for this snap is: volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:08 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d24acf5-ef8e-4d4d-a0ee-cb8dc456b763]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:08 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d Sep 23 00:19:08 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:09 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d" returned: 0 in 0.550s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:09 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff57765d-ce22-4976-80d5-5a7543f5c6ca]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:09 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:19:09 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:09 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.648s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:10 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d Sep 23 00:19:10 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:10 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-29439014-2515-4e2f-af23-83894322780a req-b802d8a0-bef5-40b5-80fb-c4d0fba97429 tempest-AttachVolumeNegativeTest-1985059259 None] Terminate volume connection completed successfully. Sep 23 00:19:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-29439014-2515-4e2f-af23-83894322780a req-b802d8a0-bef5-40b5-80fb-c4d0fba97429 tempest-AttachVolumeNegativeTest-1985059259 None] Deleting attachment 189b41b5-f346-49fd-8d28-26857dd0822b. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:19:10 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d" returned: 0 in 0.567s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:10 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d Sep 23 00:19:10 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:10 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.93ad2614-3cc5-45a3-953e-7a2024c4796d" returned: 0 in 0.449s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-93ad2614-3cc5-45a3-953e-7a2024c4796d" released by "_delete_snapshot" :: held 2.421s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" released by "delete_snapshot" :: held 2.473s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:11 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Created reservations ['482a9537-9bdb-4c0d-a83c-a22a8da32d74', '58ffdb0e-e776-468b-bcd5-7a0c92840652', '4e6623ea-eb1b-4d2c-a97b-fcbaf894db73', '29815e41-56ec-404a-b533-b6cfca62859a'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:11 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Delete snapshot completed successfully. Sep 23 00:19:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c24b295f-ec6e-4a30-8546-a1a818e2834f tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-93ad2614-3cc5-45a3-953e-7a2024c4796d-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] Creating offline snapshot 3dc25646-b52d-4950-bd7f-dcdffd409cc2 of volume e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:12 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[da408ecc-074a-4784-86d7-375de46b6f9c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:12 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:19:12 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:13 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.532s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:13 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 1G Sep 23 00:19:13 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:13 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 1G" returned: 0 in 0.674s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:13 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 Sep 23 00:19:13 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:14 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2" returned: 0 in 0.510s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:14 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 is being set with open permissions: ugo+rw Sep 23 00:19:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:14 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 Sep 23 00:19:14 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:14 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2" returned: 0 in 0.358s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:14 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e6f0b41c-0fc7-4780-8146-96277165e045 tempest-SnapshotsActionsTest-131396959 None] Create snapshot completed successfully Sep 23 00:19:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Acquiring lock "cinder-3dc25646-b52d-4950-bd7f-dcdffd409cc2-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-3dc25646-b52d-4950-bd7f-dcdffd409cc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Acquiring lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Acquiring lock "cinder-quobyte-3dc25646-b52d-4950-bd7f-dcdffd409cc2" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-3dc25646-b52d-4950-bd7f-dcdffd409cc2" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Deleting offline snapshot 3dc25646-b52d-4950-bd7f-dcdffd409cc2 of volume e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] snapshot_file for this snap is: volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:16 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[52557a2f-f46e-4689-8d0f-a9c0fb22428d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:16 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 Sep 23 00:19:16 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:16 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2" returned: 0 in 0.706s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:16 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d767df-258c-4257-8757-8ee4c1b3a7fa]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "cinder-29e222d0-ec99-40dc-af5a-d4c51a64d02f-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Lock "cinder-29e222d0-ec99-40dc-af5a-d4c51a64d02f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "cinder-quobyte-29e222d0-ec99-40dc-af5a-d4c51a64d02f" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Lock "cinder-quobyte-29e222d0-ec99-40dc-af5a-d4c51a64d02f" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:16 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:19:16 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa770c9-92ab-41ba-9ceb-5795d5f7ff8a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:17 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f Sep 23 00:19:17 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:17 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.471s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:17 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 Sep 23 00:19:17 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:17 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f" returned: 0 in 0.484s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:17 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f Sep 23 00:19:17 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:17 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2" returned: 0 in 0.445s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:17 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2 Sep 23 00:19:17 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:17 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-29e222d0-ec99-40dc-af5a-d4c51a64d02f" returned: 0 in 0.270s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Lock "cinder-quobyte-29e222d0-ec99-40dc-af5a-d4c51a64d02f" released by "delete_volume" :: held 0.832s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Created reservations ['c43f45a5-e43b-4620-b2eb-98ccb69fed90', '06ab69d5-c37d-4081-bacb-1fbe3504c87f', '6538386c-76b2-4297-9e64-75818197cfde', '33039d1f-4adc-4750-9c85-30f0bc7e1fb1'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-90e93134-aa27-4528-af53-57fac973c144 tempest-BackendsCapabilitiesAdminTestsJSON-553710462 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86481) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c1511746-74ae-4c56-9f61-5ef5b374b030 tempest-BackendsCapabilitiesAdminTestsJSON-553710462 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86481) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:18 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:19:18 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:18 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.3dc25646-b52d-4950-bd7f-dcdffd409cc2" returned: 0 in 0.344s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-3dc25646-b52d-4950-bd7f-dcdffd409cc2" released by "_delete_snapshot" :: held 2.181s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" released by "delete_snapshot" :: held 2.232s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "cinder-7ead2abd-6fcb-43d9-84b2-3b235735533c-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:18 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.333s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "cinder-7ead2abd-6fcb-43d9-84b2-3b235735533c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:18 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Deleted volume successfully. Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Created reservations ['f80011b4-c9f5-431f-9464-f3e438a69e0c', '8d4e103e-3cc3-4f68-ae51-11a2b174b3ec', 'b475e1eb-68ea-407f-98c7-95446bd3582a', '0206a4bf-49b2-4af0-bff0-523c4bf027cb'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d5686101-393b-4a43-acf8-a070424aca2c tempest-AttachVolumeNegativeTest-1985059259 None] Lock "cinder-29e222d0-ec99-40dc-af5a-d4c51a64d02f-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "cinder-quobyte-7ead2abd-6fcb-43d9-84b2-3b235735533c" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "cinder-quobyte-7ead2abd-6fcb-43d9-84b2-3b235735533c" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[488dd04d-59eb-4f5d-9535-6ee68ff24a1c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ead2abd-6fcb-43d9-84b2-3b235735533c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:18 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Delete snapshot completed successfully. Sep 23 00:19:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0091cc99-f9d4-4982-a02e-270fab85fb5c tempest-SnapshotsActionsTest-1848402057 None] Lock "cinder-3dc25646-b52d-4950-bd7f-dcdffd409cc2-delete_snapshot" released by "delete_snapshot" :: held 2.698s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:18 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ead2abd-6fcb-43d9-84b2-3b235735533c Sep 23 00:19:18 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:19 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ead2abd-6fcb-43d9-84b2-3b235735533c" returned: 0 in 0.466s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ead2abd-6fcb-43d9-84b2-3b235735533c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:19 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ead2abd-6fcb-43d9-84b2-3b235735533c Sep 23 00:19:19 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:19 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ead2abd-6fcb-43d9-84b2-3b235735533c" returned: 0 in 0.349s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "cinder-quobyte-7ead2abd-6fcb-43d9-84b2-3b235735533c" released by "delete_volume" :: held 0.885s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Created reservations ['7e6b41ed-a9e3-401a-a7c9-985d2ebef904', '89aed70a-12ff-4937-88aa-55df8f6070f2', '5a9dd907-ca18-49a0-a198-edd99c4dc79b', '90bf49f7-7e6a-49ab-996c-ee58fd25532f'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:19 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:19:19 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "cinder-7d3f78d0-67ac-4686-a80a-047807c224e8-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Lock "cinder-7d3f78d0-67ac-4686-a80a-047807c224e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "cinder-quobyte-7d3f78d0-67ac-4686-a80a-047807c224e8" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Lock "cinder-quobyte-7d3f78d0-67ac-4686-a80a-047807c224e8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Deleting offline snapshot 7d3f78d0-67ac-4686-a80a-047807c224e8 of volume e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] snapshot_file for this snap is: volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21f04a0-df28-4ff5-a5a4-6758cc3d5e3b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.492s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:20 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Deleted volume successfully. Sep 23 00:19:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f089d94a-7d9a-46c8-90d4-fe18a586f338 tempest-AttachVolumeNegativeTest-1985059259 None] Lock "cinder-7ead2abd-6fcb-43d9-84b2-3b235735533c-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:20 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:19:20 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:20 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.711s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:20 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e137d56-10f0-4a70-8702-dee818fc0405]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b Sep 23 00:19:20 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "cinder-ff4c97a9-8f6a-45ec-b70f-99c91d21f253-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Lock "cinder-ff4c97a9-8f6a-45ec-b70f-99c91d21f253-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "cinder-quobyte-ff4c97a9-8f6a-45ec-b70f-99c91d21f253" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Lock "cinder-quobyte-ff4c97a9-8f6a-45ec-b70f-99c91d21f253" acquired by "delete_volume" :: waited 0.046s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:21 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d58a5d3-7620-4671-87f7-9f77f707e6b0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253 Sep 23 00:19:21 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" returned: 0 in 0.701s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:19:21 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:22 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253" returned: 0 in 0.792s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:22 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253 Sep 23 00:19:22 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:22 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.822s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:22 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8 Sep 23 00:19:22 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:22 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ff4c97a9-8f6a-45ec-b70f-99c91d21f253" returned: 0 in 0.421s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Lock "cinder-quobyte-ff4c97a9-8f6a-45ec-b70f-99c91d21f253" released by "delete_volume" :: held 1.296s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Created reservations ['bc666300-c8fe-4a96-9b67-2e73f917a61d', '76a11fc7-8d74-47d0-bcc7-7b32541f98aa', '772b6634-7a4a-4867-8843-96d75df3f1b7', '6dc7f514-998a-4492-870e-b9607fd25256'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:22 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b.7d3f78d0-67ac-4686-a80a-047807c224e8" returned: 0 in 0.466s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:22 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:19:22 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Lock "cinder-quobyte-7d3f78d0-67ac-4686-a80a-047807c224e8" released by "_delete_snapshot" :: held 2.929s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" released by "delete_snapshot" :: held 2.969s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:22 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Created reservations ['5fd17a8b-d403-4432-ae26-dc9bf9822285', '204dfbce-e447-444c-bfcc-a4e161255fa7', 'fbed8498-02df-4870-9302-e4a411af9c43', 'd13948c3-801b-49db-9df6-99300ecce7bf'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Delete snapshot completed successfully. Sep 23 00:19:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bfcf08f3-ead7-4a48-963c-7bc584ffa014 tempest-SnapshotsActionsTest-131396959 None] Lock "cinder-7d3f78d0-67ac-4686-a80a-047807c224e8-delete_snapshot" released by "delete_snapshot" :: held 3.304s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:23 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.482s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:23 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Deleted volume successfully. Sep 23 00:19:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-88400dd0-a993-4d91-be91-faf8d978873a tempest-AttachVolumeNegativeTest-1985059259 None] Lock "cinder-ff4c97a9-8f6a-45ec-b70f-99c91d21f253-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "cinder-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Lock "cinder-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" acquired by "delete_volume" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:23 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[501bcde4-2b73-4b01-bc1b-0b7c14123b71]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:23 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b Sep 23 00:19:23 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:24 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" returned: 0 in 0.736s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:24 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b Sep 23 00:19:24 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:24 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" returned: 0 in 0.568s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Lock "cinder-quobyte-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b" released by "delete_volume" :: held 1.453s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:25 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Created reservations ['98287618-d2a3-42f0-a991-806617aff8db', '32073bdd-1a64-40c4-b4e4-f8ebd8fb1a39', '82fcd1ed-c414-41b4-8afa-aa4a5bf49988', 'd3c0770e-360c-41ed-8465-34c73f1ebedc'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:25 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:19:25 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:25 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.431s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:25 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:25 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Deleted volume successfully. Sep 23 00:19:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e150a29d-ca72-4292-9154-f0a5f32e520b tempest-SnapshotsActionsTest-131396959 None] Lock "cinder-e424fc50-43fb-4ac6-bb73-42d03cb9ca9b-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:27 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3369348d-1006-40fe-ba86-15a60423a66b tempest-GroupSnapshotsV319Test-781368399 None] Group tempest-GroupSnapshotsV319Test-Group-1016137634: creating Sep 23 00:19:27 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3369348d-1006-40fe-ba86-15a60423a66b tempest-GroupSnapshotsV319Test-781368399 None] Group tempest-GroupSnapshotsV319Test-Group-1016137634: created successfully Sep 23 00:19:27 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3369348d-1006-40fe-ba86-15a60423a66b tempest-GroupSnapshotsV319Test-781368399 None] Create group completed successfully. Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Flow 'volume_create_manager' (537e71ff-22aa-4315-96d9-1b68023d1c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216df1e3-cfbb-409c-895d-405dd6e4617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216df1e3-cfbb-409c-895d-405dd6e4617e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-157405766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d8931ca4-1093-4213-a957-6d69647d0265,host='devstack@QuobyteHD#QuobyteHD',id=8f34c9ff-25e8-4463-8903-c88c307f9bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451d90ce3bd04cd1abbc899e9a5276b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:30Z,use_quota=True,user_id='71392a1b22c042cbb9fecb38c8f74424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eac25541-d520-41c8-a526-644a8c56c0a8),volume_type_id=eac25541-d520-41c8-a526-644a8c56c0a8)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8941f8-1696-41f1-8ea7-3f9ec053d52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa8941f8-1696-41f1-8ea7-3f9ec053d52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780fefb4-f234-439e-9f40-6530df4b50c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780fefb4-f234-439e-9f40-6530df4b50c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f34c9ff-25e8-4463-8903-c88c307f9bed', 'volume_name': 'volume-8f34c9ff-25e8-4463-8903-c88c307f9bed', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6960c04c-c6fb-44d4-8d05-15c46bde88c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6960c04c-c6fb-44d4-8d05-15c46bde88c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7bcacf-a189-4c5d-8c06-79063bb16fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:29 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Volume 8f34c9ff-25e8-4463-8903-c88c307f9bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f34c9ff-25e8-4463-8903-c88c307f9bed', 'volume_size': 1} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d8931ca4-1093-4213-a957-6d69647d0265,created_at=2026-09-22T22:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-157405766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d8931ca4-1093-4213-a957-6d69647d0265,host='devstack@QuobyteHD#QuobyteHD',id=8f34c9ff-25e8-4463-8903-c88c307f9bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451d90ce3bd04cd1abbc899e9a5276b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:30Z,use_quota=True,user_id='71392a1b22c042cbb9fecb38c8f74424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eac25541-d520-41c8-a526-644a8c56c0a8),volume_type_id=eac25541-d520-41c8-a526-644a8c56c0a8)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Creating volume 8f34c9ff-25e8-4463-8903-c88c307f9bed {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:29 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:19:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:29 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed 1073741824 Sep 23 00:19:29 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:30 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed 1073741824" returned: 0 in 0.703s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:30 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed Sep 23 00:19:30 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:31 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed" returned: 0 in 0.404s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7bcacf-a189-4c5d-8c06-79063bb16fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f34c9ff-25e8-4463-8903-c88c307f9bed', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6066b3a0-eaf2-4008-986a-c40dd1ccacb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:31 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Volume volume-8f34c9ff-25e8-4463-8903-c88c307f9bed (8f34c9ff-25e8-4463-8903-c88c307f9bed): created successfully Sep 23 00:19:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6066b3a0-eaf2-4008-986a-c40dd1ccacb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Flow 'volume_create_manager' (537e71ff-22aa-4315-96d9-1b68023d1c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:31 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-fe7e334d-33a2-4838-a7b2-2ba5067ef831 tempest-GroupSnapshotsV319Test-781368399 None] Created volume successfully. Sep 23 00:19:32 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] GroupSnapshot 69abb82b-1a5c-4a9b-ad76-3e2c4ca7ff28: creating. Sep 23 00:19:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] Group snapshot 69abb82b-1a5c-4a9b-ad76-3e2c4ca7ff28: creating. {{(pid=86481) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:19:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] Creating offline snapshot 2010713e-aa14-4cb4-ada2-026a2025ef9d of volume 8f34c9ff-25e8-4463-8903-c88c307f9bed {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[d397be2c-ba7b-426f-a622-49fd74aff39b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:33 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed Sep 23 00:19:33 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:33 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed" returned: 0 in 0.591s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:33 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d 1G Sep 23 00:19:33 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:34 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d 1G" returned: 0 in 0.634s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f34c9ff-25e8-4463-8903-c88c307f9bed -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:34 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f34c9ff-25e8-4463-8903-c88c307f9bed -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d Sep 23 00:19:34 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:34 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f34c9ff-25e8-4463-8903-c88c307f9bed -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d" returned: 0 in 0.436s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:34 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:34 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d Sep 23 00:19:34 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:35 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d" returned: 0 in 0.442s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:35 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.info Sep 23 00:19:35 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:35 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.info" returned: 0 in 0.390s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:35 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:35 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.info Sep 23 00:19:35 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:35 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.info" returned: 0 in 0.418s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.056s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:36 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-fae9aab6-8f0e-4de1-ac49-b3eaff334cbf tempest-GroupSnapshotsV319Test-781368399 None] group_snapshot 69abb82b-1a5c-4a9b-ad76-3e2c4ca7ff28: created successfully Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=113,cinder:INSERT=27,cinder:DELETE=10,cinder:SELECT=88 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Flow 'volume_create_manager' (4793dece-070f-4b1a-b1d0-9df440fb5694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e98ab28-8df1-4e6c-acca-6ed978025d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e98ab28-8df1-4e6c-acca-6ed978025d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-492602916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f358cd54-b7af-4199-aa0f-25396d120fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06c9cc126df46bca7521cfbd9d02129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:37Z,use_quota=True,user_id='46925cec068e4b63b09a7d954ad071d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c02ab5b-db50-4597-b61a-fb6f5f3b8270),volume_type_id=3c02ab5b-db50-4597-b61a-fb6f5f3b8270)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c1b276-327c-4abd-b6e2-0204f810b077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c1b276-327c-4abd-b6e2-0204f810b077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73d3c56-7479-4c62-a6bf-3e6b763fa50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73d3c56-7479-4c62-a6bf-3e6b763fa50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f358cd54-b7af-4199-aa0f-25396d120fae', 'volume_name': 'volume-f358cd54-b7af-4199-aa0f-25396d120fae', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2491ef-fc81-47c0-b724-4e265b14255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2491ef-fc81-47c0-b724-4e265b14255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117cc69d-da2e-4753-81d4-b819a2efa87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:36 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Volume f358cd54-b7af-4199-aa0f-25396d120fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f358cd54-b7af-4199-aa0f-25396d120fae', 'volume_size': 1} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-492602916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f358cd54-b7af-4199-aa0f-25396d120fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06c9cc126df46bca7521cfbd9d02129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:37Z,use_quota=True,user_id='46925cec068e4b63b09a7d954ad071d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c02ab5b-db50-4597-b61a-fb6f5f3b8270),volume_type_id=3c02ab5b-db50-4597-b61a-fb6f5f3b8270)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Creating volume f358cd54-b7af-4199-aa0f-25396d120fae {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:36 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:19:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f358cd54-b7af-4199-aa0f-25396d120fae 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:36 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f358cd54-b7af-4199-aa0f-25396d120fae 1073741824 Sep 23 00:19:36 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] group_snapshot 69abb82b-1a5c-4a9b-ad76-3e2c4ca7ff28: deleting Sep 23 00:19:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-48d4ad63-2353-4bd5-9310-2df5ab9efb2b tempest-GroupSnapshotsTest-1702992388 None] Group tempest-GroupSnapshotsTest-Group-569601803: creating Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=116,cinder:UPDATE=99,cinder:INSERT=25,cinder:DELETE=7 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] group_snapshot 69abb82b-1a5c-4a9b-ad76-3e2c4ca7ff28: deleting {{(pid=86481) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:19:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-48d4ad63-2353-4bd5-9310-2df5ab9efb2b tempest-GroupSnapshotsTest-1702992388 None] Group tempest-GroupSnapshotsTest-Group-569601803: created successfully Sep 23 00:19:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-48d4ad63-2353-4bd5-9310-2df5ab9efb2b tempest-GroupSnapshotsTest-1702992388 None] Create group completed successfully. Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Acquiring lock "cinder-quobyte-8f34c9ff-25e8-4463-8903-c88c307f9bed" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Lock "cinder-quobyte-8f34c9ff-25e8-4463-8903-c88c307f9bed" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Acquiring lock "cinder-quobyte-2010713e-aa14-4cb4-ada2-026a2025ef9d" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Lock "cinder-quobyte-2010713e-aa14-4cb4-ada2-026a2025ef9d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Deleting offline snapshot 2010713e-aa14-4cb4-ada2-026a2025ef9d of volume 8f34c9ff-25e8-4463-8903-c88c307f9bed {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] snapshot_file for this snap is: volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc0a8ca-5162-4f13-b66b-3f074fee8eb7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:37 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f358cd54-b7af-4199-aa0f-25396d120fae 1073741824" returned: 0 in 0.634s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:37 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d Sep 23 00:19:37 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f358cd54-b7af-4199-aa0f-25396d120fae {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:37 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f358cd54-b7af-4199-aa0f-25396d120fae Sep 23 00:19:37 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:37 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f358cd54-b7af-4199-aa0f-25396d120fae" returned: 0 in 0.279s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117cc69d-da2e-4753-81d4-b819a2efa87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f358cd54-b7af-4199-aa0f-25396d120fae', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:37 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6406bc3b-e007-4321-8c61-652730e8d352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d" returned: 0 in 0.468s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f34c9ff-25e8-4463-8903-c88c307f9bed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:37 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Volume volume-f358cd54-b7af-4199-aa0f-25396d120fae (f358cd54-b7af-4199-aa0f-25396d120fae): created successfully Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6406bc3b-e007-4321-8c61-652730e8d352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Flow 'volume_create_manager' (4793dece-070f-4b1a-b1d0-9df440fb5694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ddf4d2-5d7e-4660-b211-72e1ea5ce45f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9a0406b8-4167-4e60-85b6-cbfbe3d82649 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Created volume successfully. Sep 23 00:19:38 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed Sep 23 00:19:38 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:38 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed" returned: 0 in 0.563s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:38 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d Sep 23 00:19:38 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:39 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Flow 'volume_create_manager' (ed539e58-be65-4909-b2b8-6b3f29dd18d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2c81ff-7f97-48fb-a0dc-aaeedcf3dd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d" returned: 0 in 0.588s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2c81ff-7f97-48fb-a0dc-aaeedcf3dd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-27753127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=127935ee-11aa-4329-8c0e-d50248268bbe,host='devstack@QuobyteHD#QuobyteHD',id=1b1e1484-8c85-4315-9722-01dd45b29154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c44c1266774d38bce42806f4aac19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:39Z,use_quota=True,user_id='401d7bd594ed4ae187a15c52b18c0b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(698f5db6-4b68-4faa-80c1-d77e38e212c0),volume_type_id=698f5db6-4b68-4faa-80c1-d77e38e212c0)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ec645c-2d6e-4a36-a271-904e5c818a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:39 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d Sep 23 00:19:39 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ec645c-2d6e-4a36-a271-904e5c818a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c2cc65-c3fe-4d50-bae5-2a44647f18f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c2cc65-c3fe-4d50-bae5-2a44647f18f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1e1484-8c85-4315-9722-01dd45b29154', 'volume_name': 'volume-1b1e1484-8c85-4315-9722-01dd45b29154', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13d33cf-6dbe-446a-b309-4856f47fe102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13d33cf-6dbe-446a-b309-4856f47fe102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e98c998-1f54-443b-a1e4-af9f21d33ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:39 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Volume 1b1e1484-8c85-4315-9722-01dd45b29154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1e1484-8c85-4315-9722-01dd45b29154', 'volume_size': 1} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=127935ee-11aa-4329-8c0e-d50248268bbe,created_at=2026-09-22T22:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-27753127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=127935ee-11aa-4329-8c0e-d50248268bbe,host='devstack@QuobyteHD#QuobyteHD',id=1b1e1484-8c85-4315-9722-01dd45b29154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c44c1266774d38bce42806f4aac19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:39Z,use_quota=True,user_id='401d7bd594ed4ae187a15c52b18c0b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(698f5db6-4b68-4faa-80c1-d77e38e212c0),volume_type_id=698f5db6-4b68-4faa-80c1-d77e38e212c0)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Creating volume 1b1e1484-8c85-4315-9722-01dd45b29154 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:39 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:39 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 1073741824 Sep 23 00:19:39 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9699cd10-cd00-4fa1-a03f-c3badccefa72 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9699cd10-cd00-4fa1-a03f-c3badccefa72 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9699cd10-cd00-4fa1-a03f-c3badccefa72 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9699cd10-cd00-4fa1-a03f-c3badccefa72 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9699cd10-cd00-4fa1-a03f-c3badccefa72 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9699cd10-cd00-4fa1-a03f-c3badccefa72 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:39 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:19:39 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:39 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed.2010713e-aa14-4cb4-ada2-026a2025ef9d" returned: 0 in 0.383s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Lock "cinder-quobyte-2010713e-aa14-4cb4-ada2-026a2025ef9d" released by "_delete_snapshot" :: held 2.166s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Lock "cinder-quobyte-8f34c9ff-25e8-4463-8903-c88c307f9bed" released by "delete_snapshot" :: held 2.203s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:39 devstack cinder-volume[86481]: WARNING cinder.quota [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-666906666 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-666906666, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:19:39 devstack cinder-volume[86481]: WARNING cinder.quota [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-666906666 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-666906666, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] Created reservations ['baf43555-681f-4406-8c60-48ae4ae17db5', 'c579382a-7e0f-465d-a856-61c080d6f755', '8b7c611d-eebb-457b-ab31-ac8e8909c265', '307aa48d-1f6f-4d1d-9c7e-975cfbf1fd6b'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:39 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9699cd10-cd00-4fa1-a03f-c3badccefa72 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.368s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-9699cd10-cd00-4fa1-a03f-c3badccefa72 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:39 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9699cd10-cd00-4fa1-a03f-c3badccefa72 tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Retype volume completed successfully. Sep 23 00:19:39 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-060ded96-ec81-44db-8d19-f9c5e587acf3 tempest-GroupSnapshotsV319Test-781368399 None] group_snapshot 69abb82b-1a5c-4a9b-ad76-3e2c4ca7ff28: deleted successfully Sep 23 00:19:39 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 1073741824" returned: 0 in 0.650s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:39 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 Sep 23 00:19:39 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:40 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154" returned: 0 in 0.293s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e98c998-1f54-443b-a1e4-af9f21d33ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1e1484-8c85-4315-9722-01dd45b29154', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b240aa-e147-4b1c-b8f1-00754d901664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:40 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Volume volume-1b1e1484-8c85-4315-9722-01dd45b29154 (1b1e1484-8c85-4315-9722-01dd45b29154): created successfully Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b240aa-e147-4b1c-b8f1-00754d901664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Flow 'volume_create_manager' (ed539e58-be65-4909-b2b8-6b3f29dd18d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:40 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a25de6fc-dbcf-4151-a2d0-85c0d63013cc tempest-GroupSnapshotsTest-1702992388 None] Created volume successfully. Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Acquiring lock "cinder-f358cd54-b7af-4199-aa0f-25396d120fae-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Lock "cinder-f358cd54-b7af-4199-aa0f-25396d120fae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Acquiring lock "cinder-quobyte-f358cd54-b7af-4199-aa0f-25396d120fae" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Lock "cinder-quobyte-f358cd54-b7af-4199-aa0f-25396d120fae" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13485d2-a423-454a-a1df-c948a359b657]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f358cd54-b7af-4199-aa0f-25396d120fae {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:40 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f358cd54-b7af-4199-aa0f-25396d120fae Sep 23 00:19:40 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Acquiring lock "cinder-quobyte-8f34c9ff-25e8-4463-8903-c88c307f9bed" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Lock "cinder-quobyte-8f34c9ff-25e8-4463-8903-c88c307f9bed" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23024cd-923d-43cf-a93b-e744fec8338e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:41 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f358cd54-b7af-4199-aa0f-25396d120fae" returned: 0 in 0.437s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f358cd54-b7af-4199-aa0f-25396d120fae {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:41 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed Sep 23 00:19:41 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:41 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f358cd54-b7af-4199-aa0f-25396d120fae Sep 23 00:19:41 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:41 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f358cd54-b7af-4199-aa0f-25396d120fae" returned: 0 in 0.288s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Lock "cinder-quobyte-f358cd54-b7af-4199-aa0f-25396d120fae" released by "delete_volume" :: held 0.789s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:41 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed" returned: 0 in 0.451s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:41 devstack cinder-volume[86481]: WARNING cinder.quota [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:19:41 devstack cinder-volume[86481]: WARNING cinder.quota [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:19:41 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed Sep 23 00:19:41 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Created reservations ['6d177105-19e8-4a6d-8b56-bd2617e38b53', 'e043822b-fccb-4c91-9cc9-b256fa3cf1c5', 'ce59e987-0e1f-4248-b864-ac7ccd917c24', 'e0f5d985-bd3e-49d1-be20-348b36997107'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:41 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:19:41 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:41 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] GroupSnapshot a714e067-7587-476a-9d94-6109aea9081f: creating. Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] Group snapshot a714e067-7587-476a-9d94-6109aea9081f: creating. {{(pid=86481) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] Creating offline snapshot 472b0e0f-4787-41bb-8230-821c78316159 of volume 1b1e1484-8c85-4315-9722-01dd45b29154 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa172bb-b892-486f-8175-907d0ae9a317]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:41 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f34c9ff-25e8-4463-8903-c88c307f9bed" returned: 0 in 0.428s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Lock "cinder-quobyte-8f34c9ff-25e8-4463-8903-c88c307f9bed" released by "delete_volume" :: held 0.984s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:42 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.377s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Created reservations ['6b034b89-60ec-41c2-b427-004513541185'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:42 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Deleted volume successfully. Sep 23 00:19:42 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 Sep 23 00:19:42 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6b5b4d50-7d13-4259-87c4-5a266a969a9f tempest-VolumeRetypeWithoutMigrationTest-91433847 None] Lock "cinder-f358cd54-b7af-4199-aa0f-25396d120fae-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:42 devstack cinder-volume[86481]: WARNING cinder.quota [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-666906666 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-666906666, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Created reservations ['06ea1317-cdca-4ed9-a372-aae2b6a2ae4d', '74287df9-aa5e-449f-a7bd-d0c871bf30ff', '2973d5ad-19ae-4826-8d11-fe0a1f21f87e', '90564984-5767-4b53-ba18-b2a366478646'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:42 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:19:42 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:42 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154" returned: 0 in 0.708s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:42 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 1G Sep 23 00:19:42 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:42 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.429s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:42 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:42 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-139769f7-3a96-4be2-aa87-72b6a7210cf3 tempest-GroupSnapshotsV319Test-781368399 None] Delete group completed successfully. Sep 23 00:19:43 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 1G" returned: 0 in 0.853s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1e1484-8c85-4315-9722-01dd45b29154 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:43 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1e1484-8c85-4315-9722-01dd45b29154 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 Sep 23 00:19:43 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:43 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1e1484-8c85-4315-9722-01dd45b29154 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159" returned: 0 in 0.449s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:43 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:43 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 Sep 23 00:19:43 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:44 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159" returned: 0 in 0.366s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:44 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.info Sep 23 00:19:44 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:44 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.info" returned: 0 in 0.340s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:44 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:44 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.info Sep 23 00:19:44 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:19:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:45 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:19:45 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.info" returned: 0 in 0.344s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.224s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:45 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-57a64519-ea53-4b98-8985-7275817c78b6 tempest-GroupSnapshotsTest-1702992388 None] group_snapshot a714e067-7587-476a-9d94-6109aea9081f: created successfully Sep 23 00:19:45 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.418s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:19:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:19:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-472b0e0f-4787-41bb-8230-821c78316159-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" by "_create_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-472b0e0f-4787-41bb-8230-821c78316159-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Creating volume 9bddcf93-1f6f-4c2e-88c5-466cdbc27a56 from snapshot 472b0e0f-4787-41bb-8230-821c78316159 {{(pid=86481) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" by "_copy_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] snapshot: 472b0e0f-4787-41bb-8230-821c78316159, volume: 9bddcf93-1f6f-4c2e-88c5-466cdbc27a56, {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb55eaa-7ff0-47a1-a86e-05b3d89dfed3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:47 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 Sep 23 00:19:47 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:47 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159" returned: 0 in 0.539s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b1e1484-8c85-4315-9722-01dd45b29154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c220c-87e6-4d9c-ab18-d5b8f4c1df81]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:48 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 Sep 23 00:19:48 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:48 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154" returned: 0 in 0.475s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:19:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Creating direct copy from snapshot {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:19:48 devstack cinder-volume[86481]: DEBUG cinder.utils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Path /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56 not found in is_blk_device check {{(pid=86481) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:19:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:48 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56 Sep 23 00:19:48 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:54 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5ac450c0-1a83-4ce8-8d95-1756eddd567d tempest-GroupsTest-1693158707 None] Group tempest-Group1-946280927: creating Sep 23 00:19:54 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5ac450c0-1a83-4ce8-8d95-1756eddd567d tempest-GroupsTest-1693158707 None] Group tempest-Group1-946280927: created successfully Sep 23 00:19:54 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5ac450c0-1a83-4ce8-8d95-1756eddd567d tempest-GroupsTest-1693158707 None] Create group completed successfully. Sep 23 00:19:56 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5f773e88-8d87-44c0-9026-117efe15c5a0 tempest-GroupsTest-1693158707 None] Group tempest-Group2-1807445963: creating Sep 23 00:19:56 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5f773e88-8d87-44c0-9026-117efe15c5a0 tempest-GroupsTest-1693158707 None] Group tempest-Group2-1807445963: created successfully Sep 23 00:19:56 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5f773e88-8d87-44c0-9026-117efe15c5a0 tempest-GroupsTest-1693158707 None] Create group completed successfully. Sep 23 00:19:57 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" returned: 0 in 8.543s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:57 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154, size 1024.00 MB, duration 8.54 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:19:57 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Converted 1024.00 MB image at 119.85 MB/s Sep 23 00:19:57 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:19:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:57 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56 Sep 23 00:19:57 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:57 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" returned: 0 in 0.300s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" released by "_copy_volume_from_snapshot" :: held 10.000s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-472b0e0f-4787-41bb-8230-821c78316159-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" released by "_create_volume_from_snapshot" :: held 10.123s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.155s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:57 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ff43e516-b14f-4da7-9889-84e9bcfb7a1b tempest-GroupSnapshotsTest-1702992388 None] Create group from source-snapshot-a714e067-7587-476a-9d94-6109aea9081f completed successfully. Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Flow 'volume_create_manager' (e930efff-a751-4747-8871-8ca1017fdb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e37c659-4754-4fbf-9010-54e6483acdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e37c659-4754-4fbf-9010-54e6483acdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-934355199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3ac74f0-b6e0-4ce7-bf0d-2ef717a0e2e5,host='devstack@QuobyteHD#QuobyteHD',id=2d4c7304-ef0b-4f1b-9e82-831c87f3f524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51329bde37304eb59c7de8f9a91c7a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:58Z,use_quota=True,user_id='be1e7ff2d6674ecbac920e781e23202a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08c7dd8b-3992-4e06-a83d-be2a8cd3f34a),volume_type_id=08c7dd8b-3992-4e06-a83d-be2a8cd3f34a)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcaacba5-3104-4fd1-823e-c94bee11bc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcaacba5-3104-4fd1-823e-c94bee11bc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe53f62-64bc-4c8f-9801-bbd01ced3683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe53f62-64bc-4c8f-9801-bbd01ced3683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d4c7304-ef0b-4f1b-9e82-831c87f3f524', 'volume_name': 'volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620bc9e5-3421-4787-8b88-d726aa38e4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620bc9e5-3421-4787-8b88-d726aa38e4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ac04d3-7eea-477d-814e-9b9750fcf482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:58 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Volume 2d4c7304-ef0b-4f1b-9e82-831c87f3f524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524', 'volume_size': 1} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e3ac74f0-b6e0-4ce7-bf0d-2ef717a0e2e5,created_at=2026-09-22T22:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-934355199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3ac74f0-b6e0-4ce7-bf0d-2ef717a0e2e5,host='devstack@QuobyteHD#QuobyteHD',id=2d4c7304-ef0b-4f1b-9e82-831c87f3f524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51329bde37304eb59c7de8f9a91c7a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:58Z,use_quota=True,user_id='be1e7ff2d6674ecbac920e781e23202a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08c7dd8b-3992-4e06-a83d-be2a8cd3f34a),volume_type_id=08c7dd8b-3992-4e06-a83d-be2a8cd3f34a)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Creating volume 2d4c7304-ef0b-4f1b-9e82-831c87f3f524 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:58 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:19:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:58 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524 1073741824 Sep 23 00:19:58 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:58 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524 1073741824" returned: 0 in 0.707s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2cec7f-208e-4bf0-be11-e8bc7a7ef452]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:59 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524 Sep 23 00:19:59 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:59 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56 Sep 23 00:19:59 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:59 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524" returned: 0 in 0.408s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ac04d3-7eea-477d-814e-9b9750fcf482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05f7803-d34d-4f9e-896f-5f86c2312fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:59 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Volume volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524 (2d4c7304-ef0b-4f1b-9e82-831c87f3f524): created successfully Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05f7803-d34d-4f9e-896f-5f86c2312fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Flow 'volume_create_manager' (e930efff-a751-4747-8871-8ca1017fdb86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d2f52c94-5633-4e00-99b3-a270167cae4f tempest-GroupsTest-1693158707 None] Created volume successfully. Sep 23 00:19:59 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" returned: 0 in 0.595s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:59 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56 Sep 23 00:19:59 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:00 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" returned: 0 in 0.306s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-9bddcf93-1f6f-4c2e-88c5-466cdbc27a56" released by "delete_volume" :: held 0.996s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:00 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['249df6e1-b0e0-42c3-810a-c5b5f1410e20'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:00 devstack cinder-volume[86481]: WARNING cinder.quota [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1114542958 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1114542958, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:00 devstack cinder-volume[86481]: WARNING cinder.quota [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1114542958 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1114542958, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:00 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['f2ee8165-5793-403f-805d-f11180b3f21b', '414ab4ad-5607-4de0-ab0b-2ba73aae69db', '707dd5d8-e656-4ff7-a573-51fe280ba02e', '4c0769f7-500b-4010-8a46-0f79529ee939'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:00 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:20:00 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:00 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.396s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:00 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:00 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f2f827b2-5518-4f10-bcbb-0d2dacb4b3ab tempest-GroupSnapshotsTest-1702992388 None] Delete group completed successfully. Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Acquiring lock "cinder-quobyte-2d4c7304-ef0b-4f1b-9e82-831c87f3f524" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Lock "cinder-quobyte-2d4c7304-ef0b-4f1b-9e82-831c87f3f524" acquired by "delete_volume" :: waited 0.034s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5014e919-0433-4cdb-a799-cba0a336c89a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:01 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] group_snapshot a714e067-7587-476a-9d94-6109aea9081f: deleting Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] group_snapshot a714e067-7587-476a-9d94-6109aea9081f: deleting {{(pid=86481) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-1b1e1484-8c85-4315-9722-01dd45b29154" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-1b1e1484-8c85-4315-9722-01dd45b29154" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-472b0e0f-4787-41bb-8230-821c78316159" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-472b0e0f-4787-41bb-8230-821c78316159" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Deleting offline snapshot 472b0e0f-4787-41bb-8230-821c78316159 of volume 1b1e1484-8c85-4315-9722-01dd45b29154 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:20:01 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524 Sep 23 00:20:01 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] snapshot_file for this snap is: volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[00da2dff-3bba-4f8e-aa46-d767d2d8d428]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:02 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 Sep 23 00:20:02 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:02 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524" returned: 0 in 0.677s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:02 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524 Sep 23 00:20:02 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:02 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159" returned: 0 in 0.679s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b1e1484-8c85-4315-9722-01dd45b29154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:20:02 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77d7a69-6bd0-4cf7-9039-55b9b57134de]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:02 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2d4c7304-ef0b-4f1b-9e82-831c87f3f524" returned: 0 in 0.522s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:02 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 Sep 23 00:20:02 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Lock "cinder-quobyte-2d4c7304-ef0b-4f1b-9e82-831c87f3f524" released by "delete_volume" :: held 1.295s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Created reservations ['d2b7c8fe-46ac-4421-876e-2fffb4d94b62'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:03 devstack cinder-volume[86481]: WARNING cinder.quota [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1185475740 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1185475740, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:03 devstack cinder-volume[86481]: WARNING cinder.quota [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1185475740 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1185475740, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Created reservations ['4a054304-7674-45c3-b859-167917c54491', '07e90437-4c85-42da-bc4f-ed0461f51a43', '5b1a1169-af5d-4c75-86ba-bb323f54f595', 'd2ba9ed7-4620-421a-8ab1-91141397b85a'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:03 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:20:03 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:03 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154" returned: 0 in 0.937s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:03 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 Sep 23 00:20:03 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:03 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-25c071bb-e5c5-459a-89ef-c651a117b993 req-db3cd0b4-bc16-49cb-8982-8c860142cd3b tempest-TestMinimumBasicScenario-2039131119 None] Terminate volume connection completed successfully. Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-25c071bb-e5c5-459a-89ef-c651a117b993 req-db3cd0b4-bc16-49cb-8982-8c860142cd3b tempest-TestMinimumBasicScenario-2039131119 None] Deleting attachment b9584641-613b-4dee-81a9-3039ef6d72da. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:20:03 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.503s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:03 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:03 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-74481610-2003-4e2b-9353-1f0a613981ec tempest-GroupsTest-1693158707 None] Delete group completed successfully. Sep 23 00:20:04 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159" returned: 0 in 0.736s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:04 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159 Sep 23 00:20:04 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-b3012920-5ec2-4e38-a6d3-944075c9d7f4 tempest-GroupsTest-1693158707 None] Created reservations ['1fba10dc-d652-4bfc-8e68-219b989842dc'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Flow 'volume_create_manager' (645fb766-ed10-475b-9d0e-30614c36d073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4880b9-1228-43b9-ba01-b7fcc9fb2e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4880b9-1228-43b9-ba01-b7fcc9fb2e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-204023963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f40bde-d1f1-4fce-bc84-756acfe44930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230f1174878a402fbf27f9939d0bc0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:04Z,use_quota=True,user_id='2691b583e0664d78b2d841ad12bf4a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5a756f-f503-4fbf-9465-4973df1094ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d5a756f-f503-4fbf-9465-4973df1094ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc996df-3a4b-4c61-94b4-e34e260bd4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc996df-3a4b-4c61-94b4-e34e260bd4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f40bde-d1f1-4fce-bc84-756acfe44930', 'volume_name': 'volume-25f40bde-d1f1-4fce-bc84-756acfe44930', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985eeb54-68da-4c1d-a48f-b66611c72708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985eeb54-68da-4c1d-a48f-b66611c72708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528ce2a6-9f12-493b-8486-0d9def4e5b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:04 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Volume 25f40bde-d1f1-4fce-bc84-756acfe44930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f40bde-d1f1-4fce-bc84-756acfe44930', 'volume_size': 1} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-204023963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f40bde-d1f1-4fce-bc84-756acfe44930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230f1174878a402fbf27f9939d0bc0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:04Z,use_quota=True,user_id='2691b583e0664d78b2d841ad12bf4a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Creating volume 25f40bde-d1f1-4fce-bc84-756acfe44930 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:04 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Acquiring lock "cinder-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:04 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 1073741824 Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Lock "cinder-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:04 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b3012920-5ec2-4e38-a6d3-944075c9d7f4 tempest-GroupsTest-1693158707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b3012920-5ec2-4e38-a6d3-944075c9d7f4 tempest-GroupsTest-1693158707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b3012920-5ec2-4e38-a6d3-944075c9d7f4 tempest-GroupsTest-1693158707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b3012920-5ec2-4e38-a6d3-944075c9d7f4 tempest-GroupsTest-1693158707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b3012920-5ec2-4e38-a6d3-944075c9d7f4 tempest-GroupsTest-1693158707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3012920-5ec2-4e38-a6d3-944075c9d7f4 tempest-GroupsTest-1693158707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:04 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:20:04 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Acquiring lock "cinder-quobyte-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Lock "cinder-quobyte-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6252b0d-4bc7-41c5-af50-549057e452f1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:04 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154.472b0e0f-4787-41bb-8230-821c78316159" returned: 0 in 0.456s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-472b0e0f-4787-41bb-8230-821c78316159" released by "_delete_snapshot" :: held 2.972s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-1b1e1484-8c85-4315-9722-01dd45b29154" released by "delete_snapshot" :: held 3.007s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:04 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f Sep 23 00:20:04 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:04 devstack cinder-volume[86481]: WARNING cinder.quota [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1114542958 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1114542958, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['990425a0-237c-46bf-822c-7471d2a6d46b', '02dba7ec-2ea7-489d-b8df-89f3865ed97c', '75dafc92-65b2-4c3c-8753-c53396af69e2', 'aa27ebfe-7cc3-451b-9744-120955538326'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:05 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3012920-5ec2-4e38-a6d3-944075c9d7f4 tempest-GroupsTest-1693158707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.358s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-b3012920-5ec2-4e38-a6d3-944075c9d7f4 tempest-GroupsTest-1693158707 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b3012920-5ec2-4e38-a6d3-944075c9d7f4 tempest-GroupsTest-1693158707 None] Delete group completed successfully. Sep 23 00:20:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-51ea7fdd-fb68-4aba-be27-956af95fee3f tempest-GroupSnapshotsTest-1702992388 None] group_snapshot a714e067-7587-476a-9d94-6109aea9081f: deleted successfully Sep 23 00:20:05 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 1073741824" returned: 0 in 0.581s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:05 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 Sep 23 00:20:05 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:05 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f" returned: 0 in 0.485s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:05 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f Sep 23 00:20:05 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:05 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930" returned: 0 in 0.334s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:05 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f" returned: 0 in 0.308s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Lock "cinder-quobyte-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f" released by "delete_volume" :: held 0.841s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528ce2a6-9f12-493b-8486-0d9def4e5b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f40bde-d1f1-4fce-bc84-756acfe44930', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a2f4d9-9ec7-496e-822b-c2dec6c3c885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:05 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Volume volume-25f40bde-d1f1-4fce-bc84-756acfe44930 (25f40bde-d1f1-4fce-bc84-756acfe44930): created successfully Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a2f4d9-9ec7-496e-822b-c2dec6c3c885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Flow 'volume_create_manager' (645fb766-ed10-475b-9d0e-30614c36d073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e1fadb74-7bc5-4a51-8465-68db42239eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Created volume successfully. Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Created reservations ['02b4de5c-8f19-493d-9dd1-17f33dd9c03e', '53248683-eca2-41e9-a855-505894fd6082', '1acf926c-9677-49ed-88eb-bc53864b2ffa', 'c2dcefef-2054-413c-8699-9201bb6d5156'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:05 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:20:05 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-1b1e1484-8c85-4315-9722-01dd45b29154" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-1b1e1484-8c85-4315-9722-01dd45b29154" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3104da-5d87-470e-b3c6-b99518aa9ac6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:06 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.385s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:06 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Deleted volume successfully. Sep 23 00:20:06 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 Sep 23 00:20:06 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-43e30450-8881-4796-a383-0613c87942d8 tempest-TestMinimumBasicScenario-2039131119 None] Lock "cinder-f11d77e9-0ea5-4de4-b6b7-e8e21a6c6b1f-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:06 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-32952ab9-8407-4c4b-8d0c-5a95dce2b58b tempest-GroupsTest-1693158707 None] Group tempest-GroupsTest-Group-416004797: creating Sep 23 00:20:06 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-32952ab9-8407-4c4b-8d0c-5a95dce2b58b tempest-GroupsTest-1693158707 None] Group tempest-GroupsTest-Group-416004797: created successfully Sep 23 00:20:06 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-32952ab9-8407-4c4b-8d0c-5a95dce2b58b tempest-GroupsTest-1693158707 None] Create group completed successfully. Sep 23 00:20:06 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154" returned: 0 in 0.509s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:06 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154 Sep 23 00:20:06 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Creating offline snapshot 7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 of volume 25f40bde-d1f1-4fce-bc84-756acfe44930 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[347a8567-6cf4-475c-b865-7960609448e3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:06 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1b1e1484-8c85-4315-9722-01dd45b29154" returned: 0 in 0.335s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-1b1e1484-8c85-4315-9722-01dd45b29154" released by "delete_volume" :: held 0.958s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:07 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 Sep 23 00:20:07 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:07 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['9e59696b-4a02-4361-aadd-fb21f34f4770'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:07 devstack cinder-volume[86481]: WARNING cinder.db.api [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1114542958'] Sep 23 00:20:07 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['ddd02bd0-9d8a-49af-a945-5937f7789c3c', '55086334-dbe3-4dce-a337-578e1e815952', '164e209e-67e3-45db-a047-c75913811b77', 'a045fc5a-3d39-44de-a5f8-4e53ce89b45c'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:07 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:20:07 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:07 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930" returned: 0 in 0.811s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:07 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 1G Sep 23 00:20:07 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:07 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.553s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:07 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:07 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7950c412-861b-492f-87ae-b6bd4ee3e3b5 tempest-GroupSnapshotsTest-1702992388 None] Delete group completed successfully. Sep 23 00:20:08 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 1G" returned: 0 in 0.984s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f40bde-d1f1-4fce-bc84-756acfe44930 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:08 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f40bde-d1f1-4fce-bc84-756acfe44930 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 Sep 23 00:20:08 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:08 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Flow 'volume_create_manager' (a6acf8c9-1818-40b1-8b20-f75b2fe84254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47208c5-1ed0-4685-b395-eba43b163a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47208c5-1ed0-4685-b395-eba43b163a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-96753714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78c095b3-d128-4060-890e-d1a9068c9049,host='devstack@QuobyteHD#QuobyteHD',id=40379d3b-ebca-4bf7-bd90-562bdeb7c9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51329bde37304eb59c7de8f9a91c7a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:09Z,use_quota=True,user_id='be1e7ff2d6674ecbac920e781e23202a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f8c7ec0-ac72-4c3d-9523-02d35ee3a9c5),volume_type_id=3f8c7ec0-ac72-4c3d-9523-02d35ee3a9c5)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2088da47-829a-4245-9dc8-d80bd1b264b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2088da47-829a-4245-9dc8-d80bd1b264b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2511c64a-a3b4-4935-9079-ad46bec6a07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2511c64a-a3b4-4935-9079-ad46bec6a07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40379d3b-ebca-4bf7-bd90-562bdeb7c9bd', 'volume_name': 'volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd529634-0e61-4925-9f7a-83a567adc7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd529634-0e61-4925-9f7a-83a567adc7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44933aaa-6c00-48f4-984d-f23bc3baa733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:09 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Volume 40379d3b-ebca-4bf7-bd90-562bdeb7c9bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd', 'volume_size': 1} Sep 23 00:20:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:09 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25f40bde-d1f1-4fce-bc84-756acfe44930 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31" returned: 0 in 0.674s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:09 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 is being set with open permissions: ugo+rw Sep 23 00:20:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:09 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 Sep 23 00:20:09 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:09 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f8376ec3-e40e-4a5e-aee8-c87909fbdd68 tempest-GroupSnapshotsTest-1702992388 None] Group tempest-GroupSnapshotsTest-Group-301689460: creating Sep 23 00:20:09 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f8376ec3-e40e-4a5e-aee8-c87909fbdd68 tempest-GroupSnapshotsTest-1702992388 None] Group tempest-GroupSnapshotsTest-Group-301689460: created successfully Sep 23 00:20:09 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f8376ec3-e40e-4a5e-aee8-c87909fbdd68 tempest-GroupSnapshotsTest-1702992388 None] Create group completed successfully. Sep 23 00:20:09 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31" returned: 0 in 0.403s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:09 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.info Sep 23 00:20:09 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:10 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.info" returned: 0 in 0.300s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:10 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.info is being set with open permissions: ugo+rw Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:10 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.info Sep 23 00:20:10 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:10 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.info" returned: 0 in 0.482s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.777s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.551s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78c095b3-d128-4060-890e-d1a9068c9049,created_at=2026-09-22T22:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-96753714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78c095b3-d128-4060-890e-d1a9068c9049,host='devstack@QuobyteHD#QuobyteHD',id=40379d3b-ebca-4bf7-bd90-562bdeb7c9bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51329bde37304eb59c7de8f9a91c7a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:09Z,use_quota=True,user_id='be1e7ff2d6674ecbac920e781e23202a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f8c7ec0-ac72-4c3d-9523-02d35ee3a9c5),volume_type_id=3f8c7ec0-ac72-4c3d-9523-02d35ee3a9c5)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Creating volume 40379d3b-ebca-4bf7-bd90-562bdeb7c9bd {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:10 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:20:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:10 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd 1073741824 Sep 23 00:20:10 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:10 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-34b0dfd4-b6fb-4abd-b57b-a9930c5d8689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Create snapshot completed successfully Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Flow 'volume_create_manager' (e45c5e3d-12e6-47be-aa0f-2bb9d005ffe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c28c21-32f0-4edf-a84b-7fc02e3f54f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:11 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c28c21-32f0-4edf-a84b-7fc02e3f54f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1984312701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d90deda-17f6-4124-87b5-ed7183de85f0,host='devstack@QuobyteHD#QuobyteHD',id=8c52e25c-4a9c-4914-94c4-49d064483945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c44c1266774d38bce42806f4aac19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:11Z,use_quota=True,user_id='401d7bd594ed4ae187a15c52b18c0b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17441b8f-4a01-4b0f-a677-a4c2cd3af2db),volume_type_id=17441b8f-4a01-4b0f-a677-a4c2cd3af2db)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cf2908-08b1-46cc-a861-1c53698c99a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cf2908-08b1-46cc-a861-1c53698c99a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac380680-3738-4a36-a66d-85122237bcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac380680-3738-4a36-a66d-85122237bcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c52e25c-4a9c-4914-94c4-49d064483945', 'volume_name': 'volume-8c52e25c-4a9c-4914-94c4-49d064483945', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1bf1ba-3233-418b-836d-e9603cb4213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1bf1ba-3233-418b-836d-e9603cb4213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4b3463-55a6-45fc-8b96-d948b74346fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Volume 8c52e25c-4a9c-4914-94c4-49d064483945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c52e25c-4a9c-4914-94c4-49d064483945', 'volume_size': 1} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd 1073741824" returned: 0 in 0.897s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:11 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd Sep 23 00:20:11 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:11 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd" returned: 0 in 0.338s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.401s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d90deda-17f6-4124-87b5-ed7183de85f0,created_at=2026-09-22T22:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1984312701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d90deda-17f6-4124-87b5-ed7183de85f0,host='devstack@QuobyteHD#QuobyteHD',id=8c52e25c-4a9c-4914-94c4-49d064483945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c44c1266774d38bce42806f4aac19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:11Z,use_quota=True,user_id='401d7bd594ed4ae187a15c52b18c0b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17441b8f-4a01-4b0f-a677-a4c2cd3af2db),volume_type_id=17441b8f-4a01-4b0f-a677-a4c2cd3af2db)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Creating volume 8c52e25c-4a9c-4914-94c4-49d064483945 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:11 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:20:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44933aaa-6c00-48f4-984d-f23bc3baa733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:12 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 1073741824 Sep 23 00:20:12 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2944e6-256b-4012-b481-3d1105804896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Acquiring lock "cinder-7a879a03-33a5-4d8d-8ef8-8b8a9a119f31-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:12 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Volume volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd (40379d3b-ebca-4bf7-bd90-562bdeb7c9bd): created successfully Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2944e6-256b-4012-b481-3d1105804896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Flow 'volume_create_manager' (a6acf8c9-1818-40b1-8b20-f75b2fe84254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "cinder-7a879a03-33a5-4d8d-8ef8-8b8a9a119f31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Acquiring lock "cinder-quobyte-25f40bde-d1f1-4fce-bc84-756acfe44930" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:12 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-fdd636a4-0b72-4ed5-9833-9db239e22803 tempest-GroupsTest-1693158707 None] Created volume successfully. Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "cinder-quobyte-25f40bde-d1f1-4fce-bc84-756acfe44930" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Acquiring lock "cinder-quobyte-7a879a03-33a5-4d8d-8ef8-8b8a9a119f31" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "cinder-quobyte-7a879a03-33a5-4d8d-8ef8-8b8a9a119f31" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Deleting offline snapshot 7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 of volume 25f40bde-d1f1-4fce-bc84-756acfe44930 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] snapshot_file for this snap is: volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fd92e1-c398-41b4-a327-e095f8c9cef4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:12 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 Sep 23 00:20:12 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:12 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 1073741824" returned: 0 in 0.640s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:12 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 Sep 23 00:20:12 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:12 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31" returned: 0 in 0.561s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25f40bde-d1f1-4fce-bc84-756acfe44930(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadb8c0f-af24-4f66-801a-ab91adf414bc]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:13 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945" returned: 0 in 0.329s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:13 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 Sep 23 00:20:13 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4b3463-55a6-45fc-8b96-d948b74346fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c52e25c-4a9c-4914-94c4-49d064483945', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d232410f-73df-4a2e-a071-eb773d23e7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:13 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Volume volume-8c52e25c-4a9c-4914-94c4-49d064483945 (8c52e25c-4a9c-4914-94c4-49d064483945): created successfully Sep 23 00:20:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d232410f-73df-4a2e-a071-eb773d23e7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Flow 'volume_create_manager' (e45c5e3d-12e6-47be-aa0f-2bb9d005ffe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:13 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d003864f-acb4-483a-8fd2-acc99d4e199c tempest-GroupSnapshotsTest-1702992388 None] Created volume successfully. Sep 23 00:20:13 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930" returned: 0 in 0.565s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:13 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 Sep 23 00:20:13 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:14 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31" returned: 0 in 0.583s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:14 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31 Sep 23 00:20:14 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Flow 'volume_create_manager' (8ea1b1dd-09d1-4ac7-b90a-fc7d6b6b886d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ce5ca4-7833-4fb7-8996-e0b9b43d2306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ce5ca4-7833-4fb7-8996-e0b9b43d2306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-464727289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78c095b3-d128-4060-890e-d1a9068c9049,host='devstack@QuobyteHD#QuobyteHD',id=9fe4e039-4876-4b3a-9e49-5ae7e1810b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51329bde37304eb59c7de8f9a91c7a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:14Z,use_quota=True,user_id='be1e7ff2d6674ecbac920e781e23202a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f8c7ec0-ac72-4c3d-9523-02d35ee3a9c5),volume_type_id=3f8c7ec0-ac72-4c3d-9523-02d35ee3a9c5)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28352ef5-8b18-4758-b0c1-ebb99d541009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28352ef5-8b18-4758-b0c1-ebb99d541009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5bb095a-afa0-4a80-bc02-dbcb584c53ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5bb095a-afa0-4a80-bc02-dbcb584c53ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe4e039-4876-4b3a-9e49-5ae7e1810b48', 'volume_name': 'volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c45fe3-887f-4248-bb45-d70d353b38e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c45fe3-887f-4248-bb45-d70d353b38e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8763cfd-845f-4e2d-8b1e-7e9a34e435e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Volume 9fe4e039-4876-4b3a-9e49-5ae7e1810b48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48', 'volume_size': 1} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78c095b3-d128-4060-890e-d1a9068c9049,created_at=2026-09-22T22:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-464727289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78c095b3-d128-4060-890e-d1a9068c9049,host='devstack@QuobyteHD#QuobyteHD',id=9fe4e039-4876-4b3a-9e49-5ae7e1810b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51329bde37304eb59c7de8f9a91c7a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:14Z,use_quota=True,user_id='be1e7ff2d6674ecbac920e781e23202a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f8c7ec0-ac72-4c3d-9523-02d35ee3a9c5),volume_type_id=3f8c7ec0-ac72-4c3d-9523-02d35ee3a9c5)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Creating volume 9fe4e039-4876-4b3a-9e49-5ae7e1810b48 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:14 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:14 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48 1073741824 Sep 23 00:20:14 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:14 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930.7a879a03-33a5-4d8d-8ef8-8b8a9a119f31" returned: 0 in 0.428s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "cinder-quobyte-7a879a03-33a5-4d8d-8ef8-8b8a9a119f31" released by "_delete_snapshot" :: held 2.364s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "cinder-quobyte-25f40bde-d1f1-4fce-bc84-756acfe44930" released by "delete_snapshot" :: held 2.412s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Created reservations ['de1bd3d4-8f4c-4a9c-819c-4f8782f55c85', '82f9edfd-9f37-4b61-bcf6-884fd5a5e501', 'beb086c4-f6cc-4029-bcc9-101b4feabc42', '32b0d73e-8871-44ab-8144-68729e002c50'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:14 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Delete snapshot completed successfully. Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f033ef28-23f8-4fd7-b8d5-55937743ee8a tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "cinder-7a879a03-33a5-4d8d-8ef8-8b8a9a119f31-delete_snapshot" released by "delete_snapshot" :: held 2.649s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Flow 'volume_create_manager' (714fec50-9e7d-4272-9b86-f81261540717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00339404-3b1a-478d-8b4e-c8ef65605d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00339404-3b1a-478d-8b4e-c8ef65605d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2105608988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d90deda-17f6-4124-87b5-ed7183de85f0,host='devstack@QuobyteHD#QuobyteHD',id=683e6f60-68b2-4e95-95ce-2cfd3d829079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c44c1266774d38bce42806f4aac19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:15Z,use_quota=True,user_id='401d7bd594ed4ae187a15c52b18c0b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17441b8f-4a01-4b0f-a677-a4c2cd3af2db),volume_type_id=17441b8f-4a01-4b0f-a677-a4c2cd3af2db)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004868da-a72f-4a9f-aaa0-30c8d96aa37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004868da-a72f-4a9f-aaa0-30c8d96aa37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2c1adf-461d-4188-a60a-a85a1f5457ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2c1adf-461d-4188-a60a-a85a1f5457ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683e6f60-68b2-4e95-95ce-2cfd3d829079', 'volume_name': 'volume-683e6f60-68b2-4e95-95ce-2cfd3d829079', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61195ace-26b8-42e8-a031-ea5c120a1881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61195ace-26b8-42e8-a031-ea5c120a1881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631782c0-70e2-4e7c-8aa4-6c6606b3a48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:14 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Volume 683e6f60-68b2-4e95-95ce-2cfd3d829079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683e6f60-68b2-4e95-95ce-2cfd3d829079', 'volume_size': 1} Sep 23 00:20:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:15 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48 1073741824" returned: 0 in 0.739s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:15 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48 Sep 23 00:20:15 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Acquiring lock "cinder-25f40bde-d1f1-4fce-bc84-756acfe44930-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "cinder-25f40bde-d1f1-4fce-bc84-756acfe44930-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:15 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48" returned: 0 in 0.374s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d90deda-17f6-4124-87b5-ed7183de85f0,created_at=2026-09-22T22:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2105608988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d90deda-17f6-4124-87b5-ed7183de85f0,host='devstack@QuobyteHD#QuobyteHD',id=683e6f60-68b2-4e95-95ce-2cfd3d829079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c44c1266774d38bce42806f4aac19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:15Z,use_quota=True,user_id='401d7bd594ed4ae187a15c52b18c0b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17441b8f-4a01-4b0f-a677-a4c2cd3af2db),volume_type_id=17441b8f-4a01-4b0f-a677-a4c2cd3af2db)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Creating volume 683e6f60-68b2-4e95-95ce-2cfd3d829079 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:15 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:15 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 1073741824 Sep 23 00:20:15 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Acquiring lock "cinder-quobyte-25f40bde-d1f1-4fce-bc84-756acfe44930" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8763cfd-845f-4e2d-8b1e-7e9a34e435e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fab4579-6d52-4556-88a8-f3e632b3377e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "cinder-quobyte-25f40bde-d1f1-4fce-bc84-756acfe44930" acquired by "delete_volume" :: waited 0.056s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:15 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Volume volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48 (9fe4e039-4876-4b3a-9e49-5ae7e1810b48): created successfully Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fab4579-6d52-4556-88a8-f3e632b3377e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Flow 'volume_create_manager' (8ea1b1dd-09d1-4ac7-b90a-fc7d6b6b886d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2d4ba3-839d-4039-a952-ee967589c23f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:15 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-fc1116cb-8ddb-4366-a813-5741364c54d2 tempest-GroupsTest-1693158707 None] Created volume successfully. Sep 23 00:20:15 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 Sep 23 00:20:15 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:16 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:16 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 1073741824" returned: 0 in 0.613s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930" returned: 0 in 0.440s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:16 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930 Sep 23 00:20:16 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:16 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 Sep 23 00:20:16 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:16 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25f40bde-d1f1-4fce-bc84-756acfe44930" returned: 0 in 0.419s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "cinder-quobyte-25f40bde-d1f1-4fce-bc84-756acfe44930" released by "delete_volume" :: held 0.983s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:16 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079" returned: 0 in 0.448s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631782c0-70e2-4e7c-8aa4-6c6606b3a48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683e6f60-68b2-4e95-95ce-2cfd3d829079', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809db75c-c4ae-4d32-9a0d-fb06081c9160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:16 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Volume volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 (683e6f60-68b2-4e95-95ce-2cfd3d829079): created successfully Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809db75c-c4ae-4d32-9a0d-fb06081c9160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Flow 'volume_create_manager' (714fec50-9e7d-4272-9b86-f81261540717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Created reservations ['3b433400-52da-4eb2-aa32-2cb0d3c6c9c5', '663937b7-3b77-4718-aad1-44435cf3078a', '066ec3d3-c02d-4820-ad95-1311f3d0a4d7', '810c5fc8-d89a-4db3-aba2-c651cb49e0c9'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-39b1e7ba-11c9-43b1-aa76-6ad456554abe tempest-GroupSnapshotsTest-1702992388 None] Created volume successfully. Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:16 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:20:16 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-618017e6-ba9b-47d8-b2cf-1a509205ed01 tempest-GroupsTest-1693158707 None] Update group completed successfully. Sep 23 00:20:17 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.297s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:17 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Deleted volume successfully. Sep 23 00:20:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a3a3594-214b-4fc7-97ac-608026f75de8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1030014426 None] Lock "cinder-25f40bde-d1f1-4fce-bc84-756acfe44930-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-24f6502e-4364-4fe6-b3e9-af6d87c7702d tempest-GroupSnapshotsTest-1702992388 None] Update group completed successfully. Sep 23 00:20:18 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a50929e7-34ee-4617-b285-ccce391dd27a tempest-GroupsTest-1693158707 None] Update group completed successfully. Sep 23 00:20:18 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-677e9e42-1b42-4950-884d-82899ff10b86 tempest-GroupSnapshotsTest-1702992388 None] Update group completed successfully. Sep 23 00:20:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7955cb51-7e63-4595-8bf9-13eb7bd4c02d tempest-GroupSnapshotsTest-1702992388 None] Update group completed successfully. Sep 23 00:20:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Acquiring lock "cinder-quobyte-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Lock "cinder-quobyte-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:20 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[506727d8-b9d2-4121-855c-a5909b5949e7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:20 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd Sep 23 00:20:20 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:20 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd" returned: 0 in 0.536s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:21 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd Sep 23 00:20:21 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:21 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:21 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-25a445dc-8a8b-490e-9bfc-c7581cc7bfd6 tempest-GroupSnapshotsTest-1702992388 None] Update group completed successfully. Sep 23 00:20:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd" returned: 0 in 0.520s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Lock "cinder-quobyte-40379d3b-ebca-4bf7-bd90-562bdeb7c9bd" released by "delete_volume" :: held 1.143s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Acquiring lock "cinder-quobyte-9fe4e039-4876-4b3a-9e49-5ae7e1810b48" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Lock "cinder-quobyte-9fe4e039-4876-4b3a-9e49-5ae7e1810b48" acquired by "delete_volume" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:21 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab88e1da-2c8d-4fee-b252-5d8cf3b895c8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:21 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48 Sep 23 00:20:21 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:22 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48" returned: 0 in 0.487s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:22 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48 Sep 23 00:20:22 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:22 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe4e039-4876-4b3a-9e49-5ae7e1810b48" returned: 0 in 0.345s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Lock "cinder-quobyte-9fe4e039-4876-4b3a-9e49-5ae7e1810b48" released by "delete_volume" :: held 0.899s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:22 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Created reservations ['3fc4c5d1-3f26-46fd-9cff-e82e27efcbad'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:22 devstack cinder-volume[86481]: WARNING cinder.quota [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1179176419 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1179176419, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:22 devstack cinder-volume[86481]: WARNING cinder.quota [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1179176419 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1179176419, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:22 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Created reservations ['1c078076-6f37-46b5-abd8-34a6d1cbba6b', '3d082bbe-cedf-41e5-abb2-dee4c0ba48a6', '7a2618ab-30f9-4058-9b60-6e69d011873d', 'ffc4eb5d-99a5-4f8b-8bc9-dfa549524197'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:22 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Created reservations ['e3a776cb-53da-4449-9669-677720d4aad3', 'c561e8ef-57ff-463e-bf08-4f157e923e0b', 'f694eb0e-ec80-4d9b-aab0-76752f04aba0', 'bcfb5ffe-aa32-4832-b826-1436671f6cc1'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:23 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:20:23 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] GroupSnapshot c37adcc2-5ece-44b5-b900-c0a19c2b1f0d: creating. Sep 23 00:20:23 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.445s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a2146fc5-bdb6-48f9-a162-236df85023ee tempest-GroupsTest-1693158707 None] Delete group completed successfully. Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Group snapshot c37adcc2-5ece-44b5-b900-c0a19c2b1f0d: creating. {{(pid=86481) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Creating offline snapshot 10fae149-cd06-4994-aff5-a729b28496da of volume 8c52e25c-4a9c-4914-94c4-49d064483945 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b72e48-9baf-4fb1-8a82-377d5498749d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:23 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 Sep 23 00:20:23 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:24 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945" returned: 0 in 0.633s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:24 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da 1G Sep 23 00:20:24 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:24 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da 1G" returned: 0 in 0.672s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c52e25c-4a9c-4914-94c4-49d064483945 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:25 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c52e25c-4a9c-4914-94c4-49d064483945 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da Sep 23 00:20:25 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:25 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c52e25c-4a9c-4914-94c4-49d064483945 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da" returned: 0 in 0.417s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:25 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:20:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:25 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da Sep 23 00:20:25 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:25 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da" returned: 0 in 0.365s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:25 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.info Sep 23 00:20:25 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:26 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.info" returned: 0 in 0.395s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:26 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:20:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:26 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.info Sep 23 00:20:26 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:26 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.info" returned: 0 in 0.366s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.004s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Creating offline snapshot 5cd796ad-35e4-40d1-a45f-080ea4a49a0f of volume 683e6f60-68b2-4e95-95ce-2cfd3d829079 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:20:26 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f16c23-fca4-41e3-9b40-8b1c8e9bb56e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:26 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 Sep 23 00:20:26 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:27 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079" returned: 0 in 0.612s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:27 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f 1G Sep 23 00:20:27 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:27 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f 1G" returned: 0 in 0.698s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:28 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f Sep 23 00:20:28 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:28 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f" returned: 0 in 0.507s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:28 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:20:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:28 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f Sep 23 00:20:28 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:28 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f" returned: 0 in 0.437s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:29 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.info Sep 23 00:20:29 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Flow 'volume_create_manager' (0b805136-399e-4e2e-a0d0-fa7c2ae4849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476aacfe-f506-4f9f-86d2-bf02a4755cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476aacfe-f506-4f9f-86d2-bf02a4755cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1783090554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2a591c-46ce-45d4-a4b4-2e50c6791aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad05d2c7d13e4240ad02289ad82adc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:29Z,use_quota=True,user_id='6944c2f607504b9a833dc396c8d880bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6ca0bda-376e-40b6-a964-93cefc5fce6b),volume_type_id=b6ca0bda-376e-40b6-a964-93cefc5fce6b)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30fd416-8bea-4f8c-a154-98ec9c88144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30fd416-8bea-4f8c-a154-98ec9c88144b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640ab3c8-ef75-4a18-82a6-fccf29da532b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640ab3c8-ef75-4a18-82a6-fccf29da532b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2a591c-46ce-45d4-a4b4-2e50c6791aeb', 'volume_name': 'volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b552b4-1257-4d29-bb6e-ad515f87514a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b552b4-1257-4d29-bb6e-ad515f87514a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7632021a-0893-442b-b5a2-944a80f1a620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:29 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Volume 5e2a591c-46ce-45d4-a4b4-2e50c6791aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb', 'volume_size': 1} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:29 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.info" returned: 0 in 0.446s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:29 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:29 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.info Sep 23 00:20:29 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:29 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.info" returned: 0 in 0.347s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.212s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1783090554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2a591c-46ce-45d4-a4b4-2e50c6791aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad05d2c7d13e4240ad02289ad82adc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:29Z,use_quota=True,user_id='6944c2f607504b9a833dc396c8d880bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6ca0bda-376e-40b6-a964-93cefc5fce6b),volume_type_id=b6ca0bda-376e-40b6-a964-93cefc5fce6b)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Creating volume 5e2a591c-46ce-45d4-a4b4-2e50c6791aeb {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:29 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:20:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:29 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb 1073741824 Sep 23 00:20:29 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:30 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0e767cd2-9196-4711-bdc1-e92d94dc2731 tempest-GroupSnapshotsTest-1702992388 None] group_snapshot c37adcc2-5ece-44b5-b900-c0a19c2b1f0d: created successfully Sep 23 00:20:30 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] group_snapshot c37adcc2-5ece-44b5-b900-c0a19c2b1f0d: deleting Sep 23 00:20:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] group_snapshot c37adcc2-5ece-44b5-b900-c0a19c2b1f0d: deleting {{(pid=86481) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:20:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-8c52e25c-4a9c-4914-94c4-49d064483945" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-8c52e25c-4a9c-4914-94c4-49d064483945" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-10fae149-cd06-4994-aff5-a729b28496da" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-10fae149-cd06-4994-aff5-a729b28496da" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Deleting offline snapshot 10fae149-cd06-4994-aff5-a729b28496da of volume 8c52e25c-4a9c-4914-94c4-49d064483945 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:20:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] snapshot_file for this snap is: volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:20:30 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94691d5-1911-4e93-827f-0464686c410b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:30 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb 1073741824" returned: 0 in 0.886s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:30 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb Sep 23 00:20:30 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:30 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da Sep 23 00:20:30 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:31 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb" returned: 0 in 0.626s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:31 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da" returned: 0 in 0.732s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c52e25c-4a9c-4914-94c4-49d064483945(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7632021a-0893-442b-b5a2-944a80f1a620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18585a1-67e5-47e4-a4f0-38d1c2a60cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8f5c0a-8948-411b-96e0-441b78f31777]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:31 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Volume volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb (5e2a591c-46ce-45d4-a4b4-2e50c6791aeb): created successfully Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18585a1-67e5-47e4-a4f0-38d1c2a60cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Flow 'volume_create_manager' (0b805136-399e-4e2e-a0d0-fa7c2ae4849c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:31 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c45ffb19-8e85-4fb3-935d-fc409c14a966 tempest-VolumeTypesAccessTest-306847771 None] Created volume successfully. Sep 23 00:20:31 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 Sep 23 00:20:31 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:31 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945" returned: 0 in 0.448s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:32 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da Sep 23 00:20:32 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:32 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da" returned: 0 in 0.425s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:32 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da Sep 23 00:20:32 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Acquiring lock "cinder-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Lock "cinder-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Acquiring lock "cinder-quobyte-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Lock "cinder-quobyte-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[073d080f-c019-4dff-95bd-a7d69d5b20cb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:32 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945.10fae149-cd06-4994-aff5-a729b28496da" returned: 0 in 0.414s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:32 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb Sep 23 00:20:32 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-10fae149-cd06-4994-aff5-a729b28496da" released by "_delete_snapshot" :: held 2.226s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-8c52e25c-4a9c-4914-94c4-49d064483945" released by "delete_snapshot" :: held 2.284s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-683e6f60-68b2-4e95-95ce-2cfd3d829079" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-683e6f60-68b2-4e95-95ce-2cfd3d829079" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-5cd796ad-35e4-40d1-a45f-080ea4a49a0f" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-5cd796ad-35e4-40d1-a45f-080ea4a49a0f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Deleting offline snapshot 5cd796ad-35e4-40d1-a45f-080ea4a49a0f of volume 683e6f60-68b2-4e95-95ce-2cfd3d829079 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] snapshot_file for this snap is: volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb749528-3700-4f33-982e-8e39b01f23fd]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:33 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f Sep 23 00:20:33 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:33 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb" returned: 0 in 0.526s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:33 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb Sep 23 00:20:33 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:33 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f" returned: 0 in 0.539s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-683e6f60-68b2-4e95-95ce-2cfd3d829079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16d8a07-e96b-4fd4-b3e9-175f2d212551]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:33 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb" returned: 0 in 0.343s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Lock "cinder-quobyte-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb" released by "delete_volume" :: held 0.926s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:33 devstack cinder-volume[86481]: WARNING cinder.quota [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2056965110 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2056965110, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:33 devstack cinder-volume[86481]: WARNING cinder.quota [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2056965110 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2056965110, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Created reservations ['195efb88-9cf3-49fe-a91b-0632c495404b', '13d509d3-c5e4-449b-a4bf-56862544cb32', 'dd226402-1b10-42ab-989e-154ad4fa0154', '71341b07-3aaa-4fbe-8c26-9a7df03c26c4'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:33 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 Sep 23 00:20:33 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:33 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:20:33 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:34 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079" returned: 0 in 0.526s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:34 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f Sep 23 00:20:34 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:34 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.363s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:34 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:34 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Deleted volume successfully. Sep 23 00:20:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5205d328-025b-411a-9c84-b6a79a10c4ef tempest-VolumeTypesAccessTest-306847771 None] Lock "cinder-5e2a591c-46ce-45d4-a4b4-2e50c6791aeb-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:34 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f" returned: 0 in 0.592s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:34 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f Sep 23 00:20:34 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:35 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079.5cd796ad-35e4-40d1-a45f-080ea4a49a0f" returned: 0 in 0.330s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-5cd796ad-35e4-40d1-a45f-080ea4a49a0f" released by "_delete_snapshot" :: held 2.133s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-683e6f60-68b2-4e95-95ce-2cfd3d829079" released by "delete_snapshot" :: held 2.176s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:35 devstack cinder-volume[86481]: WARNING cinder.quota [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-899797504 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-899797504, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:35 devstack cinder-volume[86481]: WARNING cinder.quota [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-899797504 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-899797504, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:35 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['d80abd05-2b74-47a4-951e-07e5282dc84b', '5753ab63-01ed-4f67-b9fc-8c116fc953e7', '7fbac0f1-17e2-4a07-a011-dfeee6004da0', 'b8433a20-b3fc-4d82-b5b0-9e26769e43df'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:35 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['1133749d-7e6f-46d8-b5b0-7398722e6c02', '69eaf9ef-dbd4-4060-9af6-e275f7b66004', 'a2a58ab6-7a5d-4533-89d6-e74cedcf3d6a', '3d7ca821-9864-414e-a121-d87b8992707d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:35 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-35d0bb15-2c22-4428-b259-7e3469d18612 tempest-GroupSnapshotsTest-1702992388 None] group_snapshot c37adcc2-5ece-44b5-b900-c0a19c2b1f0d: deleted successfully Sep 23 00:20:37 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=166,cinder:UPDATE=178,cinder:INSERT=38,cinder:DELETE=8 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-683e6f60-68b2-4e95-95ce-2cfd3d829079" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-683e6f60-68b2-4e95-95ce-2cfd3d829079" acquired by "delete_volume" :: waited 0.049s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6ec2c0-107f-455a-86b8-89f6d98f9d57]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:37 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 Sep 23 00:20:37 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:37 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079" returned: 0 in 0.592s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:38 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079 Sep 23 00:20:38 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:38 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-683e6f60-68b2-4e95-95ce-2cfd3d829079" returned: 0 in 0.366s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-683e6f60-68b2-4e95-95ce-2cfd3d829079" released by "delete_volume" :: held 1.147s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-8c52e25c-4a9c-4914-94c4-49d064483945" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-8c52e25c-4a9c-4914-94c4-49d064483945" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:38 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80559a8-a7b0-4a5b-9958-9c958c54865b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:38 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 Sep 23 00:20:38 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:39 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945" returned: 0 in 0.635s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:39 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945 Sep 23 00:20:39 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:39 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8c52e25c-4a9c-4914-94c4-49d064483945" returned: 0 in 0.446s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-8c52e25c-4a9c-4914-94c4-49d064483945" released by "delete_volume" :: held 1.197s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:39 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=176,cinder:UPDATE=177,cinder:INSERT=42,cinder:DELETE=6 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:39 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['ea87ba3d-30ee-4bf3-b9ba-6249027cd4c7'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:39 devstack cinder-volume[86481]: WARNING cinder.quota [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-899797504 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-899797504, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:39 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['1acaef3c-158a-4d18-885f-e0e8df79a132', '71267c2b-7686-459d-a444-da28b31635b3', '6324337a-2d74-4188-88c0-8c399e5855dd', 'e4735838-0754-44eb-8d20-2120ccdeab48'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:40 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['79125046-d7ae-4eb3-b5ca-783b1c21adfe', '76976b34-27ed-44d4-80bf-27b347b1e187', '10287729-6745-4446-889d-174c5557e1c1', 'a1dd1860-c17a-479d-8f20-ceabe64dfc7e'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:40 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:20:40 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:40 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.388s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:40 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:40 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0cc8449c-1bc3-4d07-8871-73650557590a tempest-GroupSnapshotsTest-1702992388 None] Delete group completed successfully. Sep 23 00:20:41 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f5a6088a-6a73-4697-b269-cf05eda1e1d2 tempest-GroupSnapshotsTest-1702992388 None] Group tempest-GroupSnapshotsTest-Group-172989125: creating Sep 23 00:20:41 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f5a6088a-6a73-4697-b269-cf05eda1e1d2 tempest-GroupSnapshotsTest-1702992388 None] Group tempest-GroupSnapshotsTest-Group-172989125: created successfully Sep 23 00:20:41 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f5a6088a-6a73-4697-b269-cf05eda1e1d2 tempest-GroupSnapshotsTest-1702992388 None] Create group completed successfully. Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Flow 'volume_create_manager' (a56794a7-3ee7-4ea4-9d14-498d0fad63ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf75dff3-04c8-490d-b3f1-2c3918611bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf75dff3-04c8-490d-b3f1-2c3918611bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1772412345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28ed815a-76d6-4c98-a6a6-2e784324519a,host='devstack@QuobyteHD#QuobyteHD',id=be4389da-ae0a-4a2f-9174-c60e1010afdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c44c1266774d38bce42806f4aac19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:44Z,use_quota=True,user_id='401d7bd594ed4ae187a15c52b18c0b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(139f37c3-535c-4c48-8a20-4c8b9eef2cdc),volume_type_id=139f37c3-535c-4c48-8a20-4c8b9eef2cdc)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62927fb4-7738-4b1a-9f5f-67a25590def7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62927fb4-7738-4b1a-9f5f-67a25590def7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584ccd72-886c-44a2-8935-c23d379777e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584ccd72-886c-44a2-8935-c23d379777e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be4389da-ae0a-4a2f-9174-c60e1010afdb', 'volume_name': 'volume-be4389da-ae0a-4a2f-9174-c60e1010afdb', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0ad37b-0f76-4178-8856-c40f635c7102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0ad37b-0f76-4178-8856-c40f635c7102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9eff9c-ef89-4a80-8dcc-bcf742d4103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:43 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Volume be4389da-ae0a-4a2f-9174-c60e1010afdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be4389da-ae0a-4a2f-9174-c60e1010afdb', 'volume_size': 1} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28ed815a-76d6-4c98-a6a6-2e784324519a,created_at=2026-09-22T22:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1772412345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28ed815a-76d6-4c98-a6a6-2e784324519a,host='devstack@QuobyteHD#QuobyteHD',id=be4389da-ae0a-4a2f-9174-c60e1010afdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c44c1266774d38bce42806f4aac19c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:44Z,use_quota=True,user_id='401d7bd594ed4ae187a15c52b18c0b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(139f37c3-535c-4c48-8a20-4c8b9eef2cdc),volume_type_id=139f37c3-535c-4c48-8a20-4c8b9eef2cdc)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Creating volume be4389da-ae0a-4a2f-9174-c60e1010afdb {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:43 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:20:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:43 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb 1073741824 Sep 23 00:20:43 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:44 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb 1073741824" returned: 0 in 0.648s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:44 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb Sep 23 00:20:44 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:20:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:44 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb" returned: 0 in 0.360s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:45 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:20:45 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9eff9c-ef89-4a80-8dcc-bcf742d4103a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4389da-ae0a-4a2f-9174-c60e1010afdb', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda84627-4c31-4a08-b45f-96d6d5b2ffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:45 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Volume volume-be4389da-ae0a-4a2f-9174-c60e1010afdb (be4389da-ae0a-4a2f-9174-c60e1010afdb): created successfully Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda84627-4c31-4a08-b45f-96d6d5b2ffb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Flow 'volume_create_manager' (a56794a7-3ee7-4ea4-9d14-498d0fad63ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:45 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e2d674b0-4e9b-436c-a14c-bba598cdc6ee tempest-GroupSnapshotsTest-1702992388 None] Created volume successfully. Sep 23 00:20:45 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.418s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:20:45 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] GroupSnapshot 757bc8de-a461-42b4-8082-d38b71e5fe7f: creating. Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] Group snapshot 757bc8de-a461-42b4-8082-d38b71e5fe7f: creating. {{(pid=86481) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] Creating offline snapshot 0b49903b-1660-475d-bc06-5f2e000d9d95 of volume be4389da-ae0a-4a2f-9174-c60e1010afdb {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce56af0-2922-4849-8348-e811a700bdf4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:45 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb Sep 23 00:20:45 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:46 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb" returned: 0 in 0.613s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:46 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 1G Sep 23 00:20:46 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:47 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 1G" returned: 0 in 0.635s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4389da-ae0a-4a2f-9174-c60e1010afdb -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:47 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4389da-ae0a-4a2f-9174-c60e1010afdb -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 Sep 23 00:20:47 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:47 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be4389da-ae0a-4a2f-9174-c60e1010afdb -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95" returned: 0 in 0.427s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:47 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:20:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:47 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 Sep 23 00:20:47 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:47 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95" returned: 0 in 0.385s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:47 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.info Sep 23 00:20:47 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:48 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.info" returned: 0 in 0.391s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:48 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:20:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:48 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.info Sep 23 00:20:48 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:48 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.info" returned: 0 in 0.429s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.037s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:48 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4b8c9dc5-8f2c-4cfc-9e71-f7ca34477576 tempest-GroupSnapshotsTest-1702992388 None] group_snapshot 757bc8de-a461-42b4-8082-d38b71e5fe7f: created successfully Sep 23 00:20:49 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] group_snapshot 757bc8de-a461-42b4-8082-d38b71e5fe7f: deleting Sep 23 00:20:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] group_snapshot 757bc8de-a461-42b4-8082-d38b71e5fe7f: deleting {{(pid=86481) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:20:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-be4389da-ae0a-4a2f-9174-c60e1010afdb" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-be4389da-ae0a-4a2f-9174-c60e1010afdb" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-0b49903b-1660-475d-bc06-5f2e000d9d95" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-0b49903b-1660-475d-bc06-5f2e000d9d95" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Deleting offline snapshot 0b49903b-1660-475d-bc06-5f2e000d9d95 of volume be4389da-ae0a-4a2f-9174-c60e1010afdb {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:20:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] snapshot_file for this snap is: volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:20:49 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[92da0b9f-b1a3-4068-b85f-b41b9b673ec1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:49 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 Sep 23 00:20:49 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:50 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95" returned: 0 in 0.603s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be4389da-ae0a-4a2f-9174-c60e1010afdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:20:50 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01a9ca3-83e5-4c9d-8897-4eaf782d205d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:50 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb Sep 23 00:20:50 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:50 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb" returned: 0 in 0.560s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:50 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 Sep 23 00:20:50 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:51 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95" returned: 0 in 0.671s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:51 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95 Sep 23 00:20:51 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Flow 'volume_create_manager' (e7c5aa97-1b14-4873-94e3-e2c17a05a6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:51 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dc6587-f049-40ae-86af-b4fabd78de21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb.0b49903b-1660-475d-bc06-5f2e000d9d95" returned: 0 in 0.417s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dc6587-f049-40ae-86af-b4fabd78de21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-204415557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f2c8e187a840799b7ba74a470168c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:52Z,use_quota=True,user_id='ab62008c2d49439b8b25bbda7e5b39c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2687fbfa-e781-460d-b1cb-8234bc8a3552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2687fbfa-e781-460d-b1cb-8234bc8a3552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6050db-add2-446f-a7c1-503bc5f4ad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6050db-add2-446f-a7c1-503bc5f4ad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5', 'volume_name': 'volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a6ed75-da05-48c2-b98b-aa373910e9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a6ed75-da05-48c2-b98b-aa373910e9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed305d1b-ee8c-4d9e-89ea-35688b9d6490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:51 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Volume c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5', 'volume_size': 1} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-204415557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f2c8e187a840799b7ba74a470168c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:52Z,use_quota=True,user_id='ab62008c2d49439b8b25bbda7e5b39c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Creating volume c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:51 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:20:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-0b49903b-1660-475d-bc06-5f2e000d9d95" released by "_delete_snapshot" :: held 2.520s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-be4389da-ae0a-4a2f-9174-c60e1010afdb" released by "delete_snapshot" :: held 2.569s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:52 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5 1073741824 Sep 23 00:20:52 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:52 devstack cinder-volume[86481]: WARNING cinder.quota [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1495081615 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1495081615, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:52 devstack cinder-volume[86481]: WARNING cinder.quota [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1495081615 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1495081615, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:52 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['ed0c7f5d-1aab-4260-9253-afdc99e08901', '61add2fc-3e85-4f63-916e-4d061accdc62', '9f92c03f-fb25-4d53-bd88-065d6e31485b', 'cad96934-60a6-44d3-a727-a827b0ae6f08'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:52 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-75a2282a-6132-4785-b8d0-1881ed77eeed tempest-GroupSnapshotsTest-1702992388 None] group_snapshot 757bc8de-a461-42b4-8082-d38b71e5fe7f: deleted successfully Sep 23 00:20:52 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5 1073741824" returned: 0 in 0.730s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:52 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5 Sep 23 00:20:52 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:53 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5" returned: 0 in 0.453s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed305d1b-ee8c-4d9e-89ea-35688b9d6490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17e4edf-f966-48ec-b9c5-fa220c6869a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:53 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Volume volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5 (c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5): created successfully Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17e4edf-f966-48ec-b9c5-fa220c6869a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Flow 'volume_create_manager' (e7c5aa97-1b14-4873-94e3-e2c17a05a6d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:53 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4cef2cc9-6d1c-48e2-87c4-62272438c3da tempest-VolumesListAdminTestJSON-921722541 None] Created volume successfully. Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "cinder-quobyte-be4389da-ae0a-4a2f-9174-c60e1010afdb" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-be4389da-ae0a-4a2f-9174-c60e1010afdb" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[005403a3-5e59-492d-aa24-c00aacd05837]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:53 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb Sep 23 00:20:53 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:53 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb" returned: 0 in 0.512s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:54 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb Sep 23 00:20:54 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:54 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-be4389da-ae0a-4a2f-9174-c60e1010afdb" returned: 0 in 0.450s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Lock "cinder-quobyte-be4389da-ae0a-4a2f-9174-c60e1010afdb" released by "delete_volume" :: held 1.102s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:54 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['8032da59-c6be-4d40-8482-b05236efee90'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:54 devstack cinder-volume[86481]: WARNING cinder.quota [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1495081615 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1495081615, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:20:54 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Created reservations ['a1008a53-e865-4513-aef5-f2dc0897a80c', '53873847-19cf-40cd-a35f-d1d11684d68a', '26540678-b381-46cb-8f40-39e9038b80f9', '9666e596-eced-4805-ba13-71b3619b3512'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:55 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:20:55 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Flow 'volume_create_manager' (b658ced3-1a1a-4821-8eb3-284ab5a430bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef51a6ce-81aa-48b8-9653-3278b33522ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef51a6ce-81aa-48b8-9653-3278b33522ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-444468855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142440bf-40fb-42cd-80a5-e2ef198b33cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f2c8e187a840799b7ba74a470168c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:55Z,use_quota=True,user_id='ab62008c2d49439b8b25bbda7e5b39c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18a4494-8ef5-4ed3-97fa-780ad6f8a395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18a4494-8ef5-4ed3-97fa-780ad6f8a395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf800f80-bf9b-49f4-af52-f7473f754a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf800f80-bf9b-49f4-af52-f7473f754a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '142440bf-40fb-42cd-80a5-e2ef198b33cf', 'volume_name': 'volume-142440bf-40fb-42cd-80a5-e2ef198b33cf', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc01e45f-1468-4ba8-80e6-6e6d8bf30093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc01e45f-1468-4ba8-80e6-6e6d8bf30093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4c8c42-ef58-4117-b287-67d056767f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:55 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Volume 142440bf-40fb-42cd-80a5-e2ef198b33cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-142440bf-40fb-42cd-80a5-e2ef198b33cf', 'volume_size': 1} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-444468855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142440bf-40fb-42cd-80a5-e2ef198b33cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f2c8e187a840799b7ba74a470168c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:55Z,use_quota=True,user_id='ab62008c2d49439b8b25bbda7e5b39c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Creating volume 142440bf-40fb-42cd-80a5-e2ef198b33cf {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:55 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-142440bf-40fb-42cd-80a5-e2ef198b33cf 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:55 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-142440bf-40fb-42cd-80a5-e2ef198b33cf 1073741824 Sep 23 00:20:55 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:55 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.416s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:55 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-96ba9117-3ea4-4f84-9621-659d08aad3a5 tempest-GroupSnapshotsTest-1702992388 None] Delete group completed successfully. Sep 23 00:20:55 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-142440bf-40fb-42cd-80a5-e2ef198b33cf 1073741824" returned: 0 in 0.613s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-142440bf-40fb-42cd-80a5-e2ef198b33cf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:56 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-142440bf-40fb-42cd-80a5-e2ef198b33cf Sep 23 00:20:56 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:56 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-142440bf-40fb-42cd-80a5-e2ef198b33cf" returned: 0 in 0.382s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:56 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4c8c42-ef58-4117-b287-67d056767f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-142440bf-40fb-42cd-80a5-e2ef198b33cf', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:56 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3531e0-a881-4040-a283-c9e1c6a92034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:56 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Volume volume-142440bf-40fb-42cd-80a5-e2ef198b33cf (142440bf-40fb-42cd-80a5-e2ef198b33cf): created successfully Sep 23 00:20:56 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3531e0-a881-4040-a283-c9e1c6a92034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:56 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Flow 'volume_create_manager' (b658ced3-1a1a-4821-8eb3-284ab5a430bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:56 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0911820a-5720-4c62-af0d-8c74879b3f56 tempest-VolumesListAdminTestJSON-921722541 None] Created volume successfully. Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Flow 'volume_create_manager' (39561850-20d6-4d56-8774-e5fce4fd8e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f445bb-c515-4ba7-a9fe-ebd2cb07de6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f445bb-c515-4ba7-a9fe-ebd2cb07de6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-252656869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db5d88b-3bc0-481a-87aa-7b4f21b54d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f2c8e187a840799b7ba74a470168c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:58Z,use_quota=True,user_id='ab62008c2d49439b8b25bbda7e5b39c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb11ffb2-6a31-4b77-8c1d-07bc0b00df14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb11ffb2-6a31-4b77-8c1d-07bc0b00df14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afbfeec-e9ea-4b98-b38f-b90b8e3bf540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afbfeec-e9ea-4b98-b38f-b90b8e3bf540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db5d88b-3bc0-481a-87aa-7b4f21b54d08', 'volume_name': 'volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c76082-4c18-4979-b8f2-f20870f99c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c76082-4c18-4979-b8f2-f20870f99c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e21485f-c2a9-44ec-a67c-7702ec4df36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:58 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Volume 6db5d88b-3bc0-481a-87aa-7b4f21b54d08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08', 'volume_size': 1} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-252656869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db5d88b-3bc0-481a-87aa-7b4f21b54d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f2c8e187a840799b7ba74a470168c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:58Z,use_quota=True,user_id='ab62008c2d49439b8b25bbda7e5b39c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Creating volume 6db5d88b-3bc0-481a-87aa-7b4f21b54d08 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:58 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:58 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08 1073741824 Sep 23 00:20:58 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:58 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08 1073741824" returned: 0 in 0.770s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:59 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08 Sep 23 00:20:59 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:59 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08" returned: 0 in 0.473s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e21485f-c2a9-44ec-a67c-7702ec4df36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013ce2ad-229e-4af5-8d8f-b6673dbdb8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:59 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Volume volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08 (6db5d88b-3bc0-481a-87aa-7b4f21b54d08): created successfully Sep 23 00:20:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013ce2ad-229e-4af5-8d8f-b6673dbdb8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Flow 'volume_create_manager' (39561850-20d6-4d56-8774-e5fce4fd8e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c6895fb6-9e64-4aab-84bb-2e27fcc70a71 tempest-VolumesListAdminTestJSON-921722541 None] Created volume successfully. Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Flow 'volume_create_manager' (b788fb44-a8e4-4b58-89f7-8a2d2b09a45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1223b884-ddb8-4d9d-905c-2d43600f1b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1223b884-ddb8-4d9d-905c-2d43600f1b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1711726055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9f92c4-36dc-4a06-a425-25d3d2685ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b392de4809b248d786265f7be8996f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:01Z,use_quota=True,user_id='7151eed73c104d4999b97ad7d99c60eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db71cb8c-51d2-4179-b236-d4c9c9dc1e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db71cb8c-51d2-4179-b236-d4c9c9dc1e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212ef54b-a171-4d58-8160-54dde4f917b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212ef54b-a171-4d58-8160-54dde4f917b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9f92c4-36dc-4a06-a425-25d3d2685ab5', 'volume_name': 'volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7bdfb34-c8c9-4189-9a46-03cdebf6d60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7bdfb34-c8c9-4189-9a46-03cdebf6d60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79649a1c-675b-4a16-b58a-863dde0120e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:00 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Volume 1d9f92c4-36dc-4a06-a425-25d3d2685ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5', 'volume_size': 1} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1711726055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9f92c4-36dc-4a06-a425-25d3d2685ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b392de4809b248d786265f7be8996f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:01Z,use_quota=True,user_id='7151eed73c104d4999b97ad7d99c60eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Creating volume 1d9f92c4-36dc-4a06-a425-25d3d2685ab5 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:00 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:21:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:01 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5 1073741824 Sep 23 00:21:01 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Flow 'volume_create_manager' (360897fc-cfd2-44e4-82fc-30872c13e3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5579a204-5583-4555-b2b5-d8dcbb0f3f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5579a204-5583-4555-b2b5-d8dcbb0f3f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7953b9-1d5b-4827-88e2-f65c919dcad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21ed9f2b064491681957f2a061d6ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:01Z,use_quota=True,user_id='78a25ae1975e49178f7b2e67a37ae9d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c98f2ea-2a7b-43b6-b977-a468f9e4e0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c98f2ea-2a7b-43b6-b977-a468f9e4e0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (251d34f6-455a-4cdd-8e20-b2bdd008b4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (251d34f6-455a-4cdd-8e20-b2bdd008b4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc7953b9-1d5b-4827-88e2-f65c919dcad0', 'volume_name': 'volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810d7380-e422-4f9d-9f4e-fe8f5f36ebb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810d7380-e422-4f9d-9f4e-fe8f5f36ebb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f3c5f8-f474-4d2f-939d-94d1f9f9cffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:01 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Volume bc7953b9-1d5b-4827-88e2-f65c919dcad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0', 'volume_size': 1} Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:01 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5 1073741824" returned: 0 in 0.877s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:01 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5 Sep 23 00:21:01 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:02 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5" returned: 0 in 0.457s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7953b9-1d5b-4827-88e2-f65c919dcad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21ed9f2b064491681957f2a061d6ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:01Z,use_quota=True,user_id='78a25ae1975e49178f7b2e67a37ae9d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Creating volume bc7953b9-1d5b-4827-88e2-f65c919dcad0 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:02 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:02 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0 1073741824 Sep 23 00:21:02 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79649a1c-675b-4a16-b58a-863dde0120e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad866d4-e626-430c-9662-c500c46e0382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:02 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Volume volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5 (1d9f92c4-36dc-4a06-a425-25d3d2685ab5): created successfully Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad866d4-e626-430c-9662-c500c46e0382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Flow 'volume_create_manager' (b788fb44-a8e4-4b58-89f7-8a2d2b09a45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:02 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-35ee859d-917d-41f7-85b8-fbfd7bddf48d tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Created volume successfully. Sep 23 00:21:03 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0 1073741824" returned: 0 in 0.736s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:03 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0 Sep 23 00:21:03 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:03 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0" returned: 0 in 0.546s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f3c5f8-f474-4d2f-939d-94d1f9f9cffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171a11e4-be6e-4551-aa8d-861a81993e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:03 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Volume volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0 (bc7953b9-1d5b-4827-88e2-f65c919dcad0): created successfully Sep 23 00:21:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171a11e4-be6e-4551-aa8d-861a81993e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Flow 'volume_create_manager' (360897fc-cfd2-44e4-82fc-30872c13e3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:03 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-94e1fca1-182f-433b-a718-5798b4228d29 tempest-VolumesListAdminTestJSON-631847262 None] Created volume successfully. Sep 23 00:21:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Acquiring lock "cinder-1d9f92c4-36dc-4a06-a425-25d3d2685ab5-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Lock "cinder-1d9f92c4-36dc-4a06-a425-25d3d2685ab5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Acquiring lock "cinder-quobyte-1d9f92c4-36dc-4a06-a425-25d3d2685ab5" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Lock "cinder-quobyte-1d9f92c4-36dc-4a06-a425-25d3d2685ab5" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:04 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be4e171-0e52-47e6-9994-9d5138eaedfe]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Acquiring lock "cinder-bc7953b9-1d5b-4827-88e2-f65c919dcad0-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Lock "cinder-bc7953b9-1d5b-4827-88e2-f65c919dcad0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:05 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5 Sep 23 00:21:05 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Acquiring lock "cinder-quobyte-bc7953b9-1d5b-4827-88e2-f65c919dcad0" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Lock "cinder-quobyte-bc7953b9-1d5b-4827-88e2-f65c919dcad0" acquired by "delete_volume" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd43353-26e6-416a-a8fb-1e7759cfac0c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "cinder-6db5d88b-3bc0-481a-87aa-7b4f21b54d08-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Lock "cinder-6db5d88b-3bc0-481a-87aa-7b4f21b54d08-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:05 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0 Sep 23 00:21:05 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "cinder-quobyte-6db5d88b-3bc0-481a-87aa-7b4f21b54d08" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Lock "cinder-quobyte-6db5d88b-3bc0-481a-87aa-7b4f21b54d08" acquired by "delete_volume" :: waited 0.018s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a155c0-ff56-49be-88f8-509ec34f1aac]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:05 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5" returned: 0 in 0.678s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:05 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5 Sep 23 00:21:05 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:05 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08 Sep 23 00:21:05 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:05 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0" returned: 0 in 0.610s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:05 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0 Sep 23 00:21:05 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:05 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-1d9f92c4-36dc-4a06-a425-25d3d2685ab5" returned: 0 in 0.356s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Lock "cinder-quobyte-1d9f92c4-36dc-4a06-a425-25d3d2685ab5" released by "delete_volume" :: held 1.148s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Created reservations ['58c01a5b-1c31-489b-8203-3f564415fbb7', '6da9afae-38cf-4ecd-ba76-4257c9b9c7c5', '59aceedc-5913-42d6-9ce7-2475d4dd0816', '41ab756f-0857-4c0d-99bb-c268f57c7bd1'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:06 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:21:06 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:06 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08" returned: 0 in 0.799s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:06 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bc7953b9-1d5b-4827-88e2-f65c919dcad0" returned: 0 in 0.501s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:06 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08 Sep 23 00:21:06 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Lock "cinder-quobyte-bc7953b9-1d5b-4827-88e2-f65c919dcad0" released by "delete_volume" :: held 1.211s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Created reservations ['91174b27-9631-4c78-a4c9-09435601a10c', '097ffb6e-941f-4b4f-ae3f-d817e00d8ad1', '980fa54f-27ec-420e-acea-5ca8f418faed', '394bc945-087a-4f1e-b34a-cd5bd6a24ea9'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:06 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:21:06 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:06 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.589s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:06 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:06 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Deleted volume successfully. Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6db5d88b-3bc0-481a-87aa-7b4f21b54d08" returned: 0 in 0.495s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Lock "cinder-quobyte-6db5d88b-3bc0-481a-87aa-7b4f21b54d08" released by "delete_volume" :: held 1.376s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cea07563-cab9-4339-a54b-785a70c342a3 tempest-VolumeQuotasNegativeTestJSON-2074436016 None] Lock "cinder-1d9f92c4-36dc-4a06-a425-25d3d2685ab5-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Created reservations ['f3838f2e-e79e-4c58-b295-4e436a4d5bbb', '2106c125-f7cb-449b-b680-eee0df9a683b', 'f28033fb-5f4b-4ca2-ae22-321ee2e8368d', 'def92f54-2283-435f-8245-0d608c1673b6'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:07 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:21:07 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:07 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.404s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:07 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:07 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Deleted volume successfully. Sep 23 00:21:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0063a1c8-6a73-40b8-a233-8754adf5224c tempest-VolumesListAdminTestJSON-631847262 None] Lock "cinder-bc7953b9-1d5b-4827-88e2-f65c919dcad0-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:07 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.422s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:07 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:07 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Deleted volume successfully. Sep 23 00:21:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-15bd6ed6-7e9a-4df8-8dfe-8f837a199d2e tempest-VolumesListAdminTestJSON-921722541 None] Lock "cinder-6db5d88b-3bc0-481a-87aa-7b4f21b54d08-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "cinder-142440bf-40fb-42cd-80a5-e2ef198b33cf-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Lock "cinder-142440bf-40fb-42cd-80a5-e2ef198b33cf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "cinder-quobyte-142440bf-40fb-42cd-80a5-e2ef198b33cf" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Lock "cinder-quobyte-142440bf-40fb-42cd-80a5-e2ef198b33cf" acquired by "delete_volume" :: waited 0.018s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:07 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c691617-427d-4c3b-b1c6-987889c92216]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-142440bf-40fb-42cd-80a5-e2ef198b33cf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:07 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-142440bf-40fb-42cd-80a5-e2ef198b33cf Sep 23 00:21:07 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:08 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-142440bf-40fb-42cd-80a5-e2ef198b33cf" returned: 0 in 0.528s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-142440bf-40fb-42cd-80a5-e2ef198b33cf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:08 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-142440bf-40fb-42cd-80a5-e2ef198b33cf Sep 23 00:21:08 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:08 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-142440bf-40fb-42cd-80a5-e2ef198b33cf" returned: 0 in 0.365s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Lock "cinder-quobyte-142440bf-40fb-42cd-80a5-e2ef198b33cf" released by "delete_volume" :: held 0.950s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:08 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Created reservations ['fbf488f1-280a-4ec1-aeb4-e494463f3454', '671d8100-2d4e-4a28-9553-29079c71e156', '75aaedda-ea5f-4ee3-aa19-ce6eb484fc3b', '74935cb0-4730-4e94-9c0b-67ac8a613102'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:09 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:21:09 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:09 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.399s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:09 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:09 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Deleted volume successfully. Sep 23 00:21:09 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3360fa42-3785-4633-94db-c37d7c51c15a tempest-VolumesListAdminTestJSON-921722541 None] Lock "cinder-142440bf-40fb-42cd-80a5-e2ef198b33cf-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "cinder-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Lock "cinder-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "cinder-quobyte-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Lock "cinder-quobyte-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5" acquired by "delete_volume" :: waited 0.040s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:10 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60f1040-60d0-461f-b471-034d98e78934]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:10 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5 Sep 23 00:21:10 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:11 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5" returned: 0 in 0.656s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:11 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5 Sep 23 00:21:11 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:11 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5" returned: 0 in 0.490s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Lock "cinder-quobyte-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5" released by "delete_volume" :: held 1.226s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:11 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Created reservations ['dc565aa4-2aa5-4700-87f5-c662a4f4ecce', '1fa646dc-8d78-469b-9ee2-8d2a11d7e42e', 'e4e965a9-fc18-4a14-bba9-386a2278d3b9', '4592dcad-9194-4a36-802c-83a1371e0516'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:11 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:21:11 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:12 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.369s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:12 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:12 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Deleted volume successfully. Sep 23 00:21:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1aef4f6a-5c7d-4b13-8af5-00173703434e tempest-VolumesListAdminTestJSON-921722541 None] Lock "cinder-c8c4c1fa-cf1b-4cff-aadb-e9dda6362bf5-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c2999744-0876-42c7-bea2-f29b6894889a tempest-GroupsV320Test-1080936399 None] Group tempest-GroupsV320Test-Group-168099384: creating Sep 23 00:21:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c2999744-0876-42c7-bea2-f29b6894889a tempest-GroupsV320Test-1080936399 None] Group tempest-GroupsV320Test-Group-168099384: created successfully Sep 23 00:21:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c2999744-0876-42c7-bea2-f29b6894889a tempest-GroupsV320Test-1080936399 None] Create group completed successfully. Sep 23 00:21:22 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-06f9af2c-5c8d-4762-bf17-750fbc6809f5 tempest-GroupsV320Test-1080936399 None] Created reservations ['789759e4-d203-492f-9e94-9e1615e56c9d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-06f9af2c-5c8d-4762-bf17-750fbc6809f5 tempest-GroupsV320Test-1080936399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-06f9af2c-5c8d-4762-bf17-750fbc6809f5 tempest-GroupsV320Test-1080936399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-06f9af2c-5c8d-4762-bf17-750fbc6809f5 tempest-GroupsV320Test-1080936399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-06f9af2c-5c8d-4762-bf17-750fbc6809f5 tempest-GroupsV320Test-1080936399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-06f9af2c-5c8d-4762-bf17-750fbc6809f5 tempest-GroupsV320Test-1080936399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-06f9af2c-5c8d-4762-bf17-750fbc6809f5 tempest-GroupsV320Test-1080936399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:22 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:21:22 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:23 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-06f9af2c-5c8d-4762-bf17-750fbc6809f5 tempest-GroupsV320Test-1080936399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.457s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:23 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-06f9af2c-5c8d-4762-bf17-750fbc6809f5 tempest-GroupsV320Test-1080936399 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-06f9af2c-5c8d-4762-bf17-750fbc6809f5 tempest-GroupsV320Test-1080936399 None] Delete group completed successfully. Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Flow 'volume_create_manager' (2c944190-7413-44f3-9966-6db8c5fa02d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f19f04a-2938-4ab3-87da-90e196a6bb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f19f04a-2938-4ab3-87da-90e196a6bb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1042560979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f45fdca-04f8-46f9-876b-391311001eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ad19a402d644aebec6f083d2178239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:24Z,use_quota=True,user_id='442846f9d5db4f129e36042ec0c60567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c2be81-2ed4-4ec8-b83d-4ecbb28451b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c2be81-2ed4-4ec8-b83d-4ecbb28451b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed01da3-71c2-4381-b261-5505bf62fc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed01da3-71c2-4381-b261-5505bf62fc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f45fdca-04f8-46f9-876b-391311001eca', 'volume_name': 'volume-8f45fdca-04f8-46f9-876b-391311001eca', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154914cf-b27d-4d9f-b4b4-328d34fbffaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154914cf-b27d-4d9f-b4b4-328d34fbffaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43baebe-fe4e-4fa6-842c-af82c68a608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:24 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Volume 8f45fdca-04f8-46f9-876b-391311001eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f45fdca-04f8-46f9-876b-391311001eca', 'volume_size': 1} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1042560979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f45fdca-04f8-46f9-876b-391311001eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ad19a402d644aebec6f083d2178239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:24Z,use_quota=True,user_id='442846f9d5db4f129e36042ec0c60567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Creating volume 8f45fdca-04f8-46f9-876b-391311001eca {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:24 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:21:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f45fdca-04f8-46f9-876b-391311001eca 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:24 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f45fdca-04f8-46f9-876b-391311001eca 1073741824 Sep 23 00:21:24 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:25 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f45fdca-04f8-46f9-876b-391311001eca 1073741824" returned: 0 in 0.865s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f45fdca-04f8-46f9-876b-391311001eca {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:25 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f45fdca-04f8-46f9-876b-391311001eca Sep 23 00:21:25 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:25 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f45fdca-04f8-46f9-876b-391311001eca" returned: 0 in 0.550s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43baebe-fe4e-4fa6-842c-af82c68a608e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f45fdca-04f8-46f9-876b-391311001eca', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fbdb70-aabe-420a-b66c-f516ac5ebde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:26 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Volume volume-8f45fdca-04f8-46f9-876b-391311001eca (8f45fdca-04f8-46f9-876b-391311001eca): created successfully Sep 23 00:21:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fbdb70-aabe-420a-b66c-f516ac5ebde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Flow 'volume_create_manager' (2c944190-7413-44f3-9966-6db8c5fa02d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:26 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1fa95cf7-b373-4a81-a6e3-3658400d032f tempest-VolumesMetadataTest-1918021010 None] Created volume successfully. Sep 23 00:21:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Acquiring lock "cinder-8f45fdca-04f8-46f9-876b-391311001eca-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Lock "cinder-8f45fdca-04f8-46f9-876b-391311001eca-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Acquiring lock "cinder-quobyte-8f45fdca-04f8-46f9-876b-391311001eca" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Lock "cinder-quobyte-8f45fdca-04f8-46f9-876b-391311001eca" acquired by "delete_volume" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:28 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d78496f-850e-49c3-9b66-a4fb5d036164]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f45fdca-04f8-46f9-876b-391311001eca {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:28 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f45fdca-04f8-46f9-876b-391311001eca Sep 23 00:21:28 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:29 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f45fdca-04f8-46f9-876b-391311001eca" returned: 0 in 0.810s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f45fdca-04f8-46f9-876b-391311001eca {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:29 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f45fdca-04f8-46f9-876b-391311001eca Sep 23 00:21:29 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:29 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8f45fdca-04f8-46f9-876b-391311001eca" returned: 0 in 0.401s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Lock "cinder-quobyte-8f45fdca-04f8-46f9-876b-391311001eca" released by "delete_volume" :: held 1.308s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:29 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Created reservations ['37725c47-8d54-425c-891e-f87dcbd18719', '40468c86-6113-4595-90c8-4b643fbf0fa4', 'd8cc22dc-8ee0-484b-9c12-094e9c542b80', '37b61511-ebd7-438f-aa6d-a190b9b86cef'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:30 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:21:30 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:30 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.389s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:30 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:30 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Deleted volume successfully. Sep 23 00:21:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b08a29c9-597d-4fb6-97c2-565a3424f577 tempest-VolumesMetadataTest-1918021010 None] Lock "cinder-8f45fdca-04f8-46f9-876b-391311001eca-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:39 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=86,cinder:UPDATE=106,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:39 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=86,cinder:INSERT=30,cinder:UPDATE=117,cinder:DELETE=5 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:39 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Flow 'volume_create_manager' (e9c1258c-414e-4e6c-aae5-ef5c13f1f682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088e8b2e-72ff-446d-a171-6970c923a605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088e8b2e-72ff-446d-a171-6970c923a605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-230642024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff10223-cc03-436c-9656-c45380d5b8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1737e0253e92409fadb5c84bf1419ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:40Z,use_quota=True,user_id='4338a01a847549eca61ee7c9682107fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b8212c-584c-4601-a883-00081d52ef1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b8212c-584c-4601-a883-00081d52ef1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52682ec1-005d-4b24-a69a-5332a3d5eaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52682ec1-005d-4b24-a69a-5332a3d5eaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff10223-cc03-436c-9656-c45380d5b8ce', 'volume_name': 'volume-0ff10223-cc03-436c-9656-c45380d5b8ce', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82285591-b1ad-4bb5-bcef-7c80c735e6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82285591-b1ad-4bb5-bcef-7c80c735e6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840671a9-5fa7-479d-ba38-48d5622c937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:40 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Volume 0ff10223-cc03-436c-9656-c45380d5b8ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff10223-cc03-436c-9656-c45380d5b8ce', 'volume_size': 1} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-230642024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff10223-cc03-436c-9656-c45380d5b8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1737e0253e92409fadb5c84bf1419ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:40Z,use_quota=True,user_id='4338a01a847549eca61ee7c9682107fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Creating volume 0ff10223-cc03-436c-9656-c45380d5b8ce {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:40 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0ff10223-cc03-436c-9656-c45380d5b8ce 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:40 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0ff10223-cc03-436c-9656-c45380d5b8ce 1073741824 Sep 23 00:21:40 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:40 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0ff10223-cc03-436c-9656-c45380d5b8ce 1073741824" returned: 0 in 0.655s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0ff10223-cc03-436c-9656-c45380d5b8ce {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:40 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0ff10223-cc03-436c-9656-c45380d5b8ce Sep 23 00:21:40 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:41 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0ff10223-cc03-436c-9656-c45380d5b8ce" returned: 0 in 0.412s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:41 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840671a9-5fa7-479d-ba38-48d5622c937e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff10223-cc03-436c-9656-c45380d5b8ce', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0becbb61-2f38-4a0d-ba2e-136cafb6e9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:41 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Volume volume-0ff10223-cc03-436c-9656-c45380d5b8ce (0ff10223-cc03-436c-9656-c45380d5b8ce): created successfully Sep 23 00:21:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0becbb61-2f38-4a0d-ba2e-136cafb6e9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Flow 'volume_create_manager' (e9c1258c-414e-4e6c-aae5-ef5c13f1f682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:41 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-bfe8b19f-5f5f-4784-a506-113478e8b401 tempest-VolumesTransfersTest-594161129 None] Created volume successfully. Sep 23 00:21:43 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5f4bcd7f-df9c-4d9b-b52c-2864f842d1cc tempest-VolumesTransfersTest-1755132897 None] Transfer volume completed successfully. Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Acquiring lock "cinder-0ff10223-cc03-436c-9656-c45380d5b8ce-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Lock "cinder-0ff10223-cc03-436c-9656-c45380d5b8ce-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Acquiring lock "cinder-quobyte-0ff10223-cc03-436c-9656-c45380d5b8ce" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Lock "cinder-quobyte-0ff10223-cc03-436c-9656-c45380d5b8ce" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f35452-2436-4e0c-abc2-b1da0c9aa489]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0ff10223-cc03-436c-9656-c45380d5b8ce {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:45 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:21:45 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:45 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0ff10223-cc03-436c-9656-c45380d5b8ce Sep 23 00:21:45 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:45 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.511s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:21:45 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0ff10223-cc03-436c-9656-c45380d5b8ce" returned: 0 in 0.654s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0ff10223-cc03-436c-9656-c45380d5b8ce {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:45 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0ff10223-cc03-436c-9656-c45380d5b8ce Sep 23 00:21:45 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Flow 'volume_create_manager' (4a1354c6-929b-4579-a2a5-d9073b88e95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b87400-47f4-4c39-b8c9-0d8013826196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b87400-47f4-4c39-b8c9-0d8013826196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-112305353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2a0188-33b3-4dab-9970-dded3bbc080a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa3ef6755edd416eb8c529b18de52334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:46Z,use_quota=True,user_id='c8adb1a1af1c460490b7da4da6e1a931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0caa3b7e-4a2b-4342-b917-f3503b4a59d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0caa3b7e-4a2b-4342-b917-f3503b4a59d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6158f53e-3128-419f-a794-02725fd90d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6158f53e-3128-419f-a794-02725fd90d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2a0188-33b3-4dab-9970-dded3bbc080a', 'volume_name': 'volume-7a2a0188-33b3-4dab-9970-dded3bbc080a', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2171faf4-13d9-4096-8601-3b463299ebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2171faf4-13d9-4096-8601-3b463299ebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2ef345-ceb1-4baa-a802-36aa5341bcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:45 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Volume 7a2a0188-33b3-4dab-9970-dded3bbc080a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2a0188-33b3-4dab-9970-dded3bbc080a', 'volume_size': 1} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-112305353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2a0188-33b3-4dab-9970-dded3bbc080a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa3ef6755edd416eb8c529b18de52334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:46Z,use_quota=True,user_id='c8adb1a1af1c460490b7da4da6e1a931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Creating volume 7a2a0188-33b3-4dab-9970-dded3bbc080a {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:45 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:21:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a2a0188-33b3-4dab-9970-dded3bbc080a 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:45 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0ff10223-cc03-436c-9656-c45380d5b8ce" returned: 0 in 0.481s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:46 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a2a0188-33b3-4dab-9970-dded3bbc080a 1073741824 Sep 23 00:21:46 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Lock "cinder-quobyte-0ff10223-cc03-436c-9656-c45380d5b8ce" released by "delete_volume" :: held 1.216s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Created reservations ['59c8c179-6bf2-4b59-a855-41c6a54742a2', 'a1be3f75-6058-4e31-b5d0-4ae3e7dc2967', '751654d4-6179-4c22-b604-58b7bf5fe96d', 'b8b75501-6c9d-4b2c-8257-b75d0bbd0f51'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:46 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:21:46 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:46 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a2a0188-33b3-4dab-9970-dded3bbc080a 1073741824" returned: 0 in 0.715s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:46 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.453s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:46 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Deleted volume successfully. Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a2a0188-33b3-4dab-9970-dded3bbc080a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:46 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a2a0188-33b3-4dab-9970-dded3bbc080a Sep 23 00:21:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c978b7dd-623a-41cd-9746-a65fcbdda349 tempest-VolumesTransfersTest-302034337 None] Lock "cinder-0ff10223-cc03-436c-9656-c45380d5b8ce-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:46 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:47 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a2a0188-33b3-4dab-9970-dded3bbc080a" returned: 0 in 0.356s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2ef345-ceb1-4baa-a802-36aa5341bcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2a0188-33b3-4dab-9970-dded3bbc080a', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea73de5-4b7c-44a2-b86d-bc04ad7c6888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:47 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Volume volume-7a2a0188-33b3-4dab-9970-dded3bbc080a (7a2a0188-33b3-4dab-9970-dded3bbc080a): created successfully Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea73de5-4b7c-44a2-b86d-bc04ad7c6888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Flow 'volume_create_manager' (4a1354c6-929b-4579-a2a5-d9073b88e95b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:47 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7f832d45-a077-4e40-986e-f6942755f694 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Created volume successfully. Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Flow 'volume_create_manager' (8e3a3cb1-0bbb-4682-858b-3b065be9e235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3a0833-b314-4bf7-9eba-d0746c121bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3a0833-b314-4bf7-9eba-d0746c121bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-574888317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7488c0-a919-48e3-a4e8-d74781cb7ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1737e0253e92409fadb5c84bf1419ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:48Z,use_quota=True,user_id='4338a01a847549eca61ee7c9682107fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8c06df-06c0-419b-96ac-5e2c82bc5ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8c06df-06c0-419b-96ac-5e2c82bc5ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01551aa2-54ae-46bf-a50b-1ead1fcd5b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01551aa2-54ae-46bf-a50b-1ead1fcd5b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c7488c0-a919-48e3-a4e8-d74781cb7ce7', 'volume_name': 'volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38960dd-1fe8-44c9-937c-3e151813ae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38960dd-1fe8-44c9-937c-3e151813ae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3cbbcc-759b-4fc8-bd42-eaff59b13a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:48 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Volume 6c7488c0-a919-48e3-a4e8-d74781cb7ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7', 'volume_size': 1} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-574888317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7488c0-a919-48e3-a4e8-d74781cb7ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1737e0253e92409fadb5c84bf1419ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:48Z,use_quota=True,user_id='4338a01a847549eca61ee7c9682107fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Creating volume 6c7488c0-a919-48e3-a4e8-d74781cb7ce7 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:48 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:48 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7 1073741824 Sep 23 00:21:48 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:48 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7 1073741824" returned: 0 in 0.905s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:49 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7 Sep 23 00:21:49 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Flow 'volume_create_manager' (24a1941f-96c9-405c-a389-31a7c45af973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82eb25b9-3259-49c8-9431-2b108174add4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:49 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7" returned: 0 in 0.489s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82eb25b9-3259-49c8-9431-2b108174add4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-422017704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38cccad6-7634-4803-970e-f231698b1e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe299bd432544ac1a032fd7751c39ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:49Z,use_quota=True,user_id='541262daa29841859ea8b34701d7e968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2a4a08-371e-4224-9fc6-9ba497fc846a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2a4a08-371e-4224-9fc6-9ba497fc846a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d31742-00e3-4986-af02-fac40e3ede63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.image.glance [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Creating Keystone auth plugin from conf {{(pid=86481) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-4b03f3dc-ca5a-45a3-b698-608419fde848 req-f30dfabe-207f-427b-9c32-49a3fc9d6e7f tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-4b03f3dc-ca5a-45a3-b698-608419fde848 req-f30dfabe-207f-427b-9c32-49a3fc9d6e7f tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3cbbcc-759b-4fc8-bd42-eaff59b13a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16dd399-99b1-4747-a083-2f29aeacbc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-4b03f3dc-ca5a-45a3-b698-608419fde848 req-f30dfabe-207f-427b-9c32-49a3fc9d6e7f tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:49 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Volume volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7 (6c7488c0-a919-48e3-a4e8-d74781cb7ce7): created successfully Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16dd399-99b1-4747-a083-2f29aeacbc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Flow 'volume_create_manager' (8e3a3cb1-0bbb-4682-858b-3b065be9e235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:49 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-01a99fd3-c317-4b55-a65d-73414c8174c3 tempest-VolumesTransfersTest-594161129 None] Created volume successfully. Sep 23 00:21:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-4b03f3dc-ca5a-45a3-b698-608419fde848 req-f30dfabe-207f-427b-9c32-49a3fc9d6e7f tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-7a2a0188-33b3-4dab-9970-dded3bbc080a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acf8d0b8-e252-41a4-a511-5a46dd0e5c55', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:21:49 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-4b03f3dc-ca5a-45a3-b698-608419fde848 req-f30dfabe-207f-427b-9c32-49a3fc9d6e7f tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] attachment_update completed successfully. Sep 23 00:21:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d31742-00e3-4986-af02-fac40e3ede63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38cccad6-7634-4803-970e-f231698b1e81', 'volume_name': 'volume-38cccad6-7634-4803-970e-f231698b1e81', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2150b26f-b5f1-41fc-aaba-f0d0be378b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2150b26f-b5f1-41fc-aaba-f0d0be378b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a82cb35-b5b8-4dfb-9994-0fc22850a94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:50 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Volume 38cccad6-7634-4803-970e-f231698b1e81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38cccad6-7634-4803-970e-f231698b1e81', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:21:50 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Trying to clone 38cccad6-7634-4803-970e-f231698b1e81 from image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]). {{(pid=86481) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:21:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Acquiring lock "cinder-6c7488c0-a919-48e3-a4e8-d74781cb7ce7-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Lock "cinder-6c7488c0-a919-48e3-a4e8-d74781cb7ce7-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Acquiring lock "cinder-quobyte-6c7488c0-a919-48e3-a4e8-d74781cb7ce7" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Lock "cinder-quobyte-6c7488c0-a919-48e3-a4e8-d74781cb7ce7" acquired by "delete_volume" :: waited 0.041s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:51 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8105d1-6b06-4154-9abd-6e56b41b5c30]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:51 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:21:51 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:21:51 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac1c617-9919-4065-b3e2-c625fe01f3cf]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:51 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7 Sep 23 00:21:51 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:51 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD Sep 23 00:21:51 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:51 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:51 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:51 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Temporary image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 is fetched for user 541262daa29841859ea8b34701d7e968. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:21:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7" returned: 0 in 0.636s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:51 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7 Sep 23 00:21:51 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:51 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f921e47a-d0f3-4431-a5fb-e1cb8a62149a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:51 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD Sep 23 00:21:52 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:52 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6c7488c0-a919-48e3-a4e8-d74781cb7ce7" returned: 0 in 0.320s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Lock "cinder-quobyte-6c7488c0-a919-48e3-a4e8-d74781cb7ce7" released by "delete_volume" :: held 1.042s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Created reservations ['2a69e3f3-12e1-4eab-bf07-1c86d6e53630', 'e1871f2b-e2f3-49bf-880b-e186586b04ea', 'f01822e8-73d9-4f14-b19d-0cb1893328fa', 'f6c67068-bfe5-4dd9-ac77-5866e82057e9'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:52 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-422017704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38cccad6-7634-4803-970e-f231698b1e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe299bd432544ac1a032fd7751c39ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:49Z,use_quota=True,user_id='541262daa29841859ea8b34701d7e968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Creating volume 38cccad6-7634-4803-970e-f231698b1e81 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:52 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:52 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:21:52 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:52 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 1073741824 Sep 23 00:21:52 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:52 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.389s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:52 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Deleted volume successfully. Sep 23 00:21:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3075abd7-371a-4f20-9cc4-08d9050971dd tempest-VolumesTransfersTest-302034337 None] Lock "cinder-6c7488c0-a919-48e3-a4e8-d74781cb7ce7-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:52 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 1073741824" returned: 0 in 0.693s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:53 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 Sep 23 00:21:53 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:53 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81" returned: 0 in 0.430s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:53 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Attempting download of 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}])) to volume 38cccad6-7634-4803-970e-f231698b1e81. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:21:53 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3aaaa4-ed81-45fc-85d8-ee917c33248c]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_6_0s1vn5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:53 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_6_0s1vn5 Sep 23 00:21:53 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:54 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_6_0s1vn5" returned: 0 in 0.438s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_6_0s1vn5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:54 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_6_0s1vn5 Sep 23 00:21:54 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:54 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_6_0s1vn5" returned: 1 in 0.530s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_6_0s1vn5' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:21:54 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d8dba4-5f74-4e66-b51b-461f6797f281]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:54 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD Sep 23 00:21:54 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:55 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD" returned: 0 in 0.536s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:55 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 was qcow2, converting to qcow2 {{(pid=86481) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:21:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:55 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 Sep 23 00:21:55 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:55 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-d9d30f73-7a6c-4a28-8201-514703affe51 req-c582225a-f058-4daa-a821-12e3d74bbaef tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Terminate volume connection completed successfully. Sep 23 00:21:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-d9d30f73-7a6c-4a28-8201-514703affe51 req-c582225a-f058-4daa-a821-12e3d74bbaef tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Deleting attachment acf8d0b8-e252-41a4-a511-5a46dd0e5c55. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:21:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Acquiring lock "cinder-7a2a0188-33b3-4dab-9970-dded3bbc080a-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Lock "cinder-7a2a0188-33b3-4dab-9970-dded3bbc080a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Acquiring lock "cinder-quobyte-7a2a0188-33b3-4dab-9970-dded3bbc080a" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Lock "cinder-quobyte-7a2a0188-33b3-4dab-9970-dded3bbc080a" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:56 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ae46c3-f5ee-40d1-ba4f-70f768907042]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a2a0188-33b3-4dab-9970-dded3bbc080a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:56 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a2a0188-33b3-4dab-9970-dded3bbc080a Sep 23 00:21:56 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:57 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a2a0188-33b3-4dab-9970-dded3bbc080a" returned: 0 in 0.758s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a2a0188-33b3-4dab-9970-dded3bbc080a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:57 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a2a0188-33b3-4dab-9970-dded3bbc080a Sep 23 00:21:57 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:57 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a2a0188-33b3-4dab-9970-dded3bbc080a" returned: 0 in 0.578s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Lock "cinder-quobyte-7a2a0188-33b3-4dab-9970-dded3bbc080a" released by "delete_volume" :: held 1.432s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:57 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Created reservations ['ef5c8434-ae06-40e8-855d-00969c5be916', 'dd02fade-abeb-41fe-915e-cf49a700122f', '80fe6c29-071a-4096-82e3-bf04b915a274', 'ba2763f0-369d-4504-ab23-f41637e222b3'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:58 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:21:58 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:58 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81" returned: 0 in 3.208s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_68vt4vl2devstack@QuobyteHD, size 112.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:21:58 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Converted 112.00 MB image at 34.87 MB/s Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:58 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 1G Sep 23 00:21:58 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:58 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.356s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:58 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Deleted volume successfully. Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-60d4688f-3af3-4f5b-835d-75831e243e04 tempest-TestServerVolumeAttachScenarioOldVersion-1572578802 None] Lock "cinder-7a2a0188-33b3-4dab-9970-dded3bbc080a-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:58 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 1G" returned: 0 in 0.574s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Downloaded image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}])) to volume 38cccad6-7634-4803-970e-f231698b1e81 successfully. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Temporary image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 for user 541262daa29841859ea8b34701d7e968 is deleted. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Marking volume 38cccad6-7634-4803-970e-f231698b1e81 as bootable. {{(pid=86481) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Copying metadata from image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 to 38cccad6-7634-4803-970e-f231698b1e81. {{(pid=86481) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:21:58 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Creating volume glance metadata for volume 38cccad6-7634-4803-970e-f231698b1e81 backed by image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86481) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:21:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a82cb35-b5b8-4dfb-9994-0fc22850a94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38cccad6-7634-4803-970e-f231698b1e81', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120481d7-26bb-4e0c-9cce-0e0ca50e2e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:59 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Volume volume-38cccad6-7634-4803-970e-f231698b1e81 (38cccad6-7634-4803-970e-f231698b1e81): created successfully Sep 23 00:21:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120481d7-26bb-4e0c-9cce-0e0ca50e2e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Flow 'volume_create_manager' (24a1941f-96c9-405c-a389-31a7c45af973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-bf42c192-6509-4995-b5fa-a472f5a8bdcf tempest-VolumesImageMetadata-1138155269 None] Created volume successfully. Sep 23 00:22:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Acquiring lock "cinder-38cccad6-7634-4803-970e-f231698b1e81-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Lock "cinder-38cccad6-7634-4803-970e-f231698b1e81-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Acquiring lock "cinder-quobyte-38cccad6-7634-4803-970e-f231698b1e81" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Lock "cinder-quobyte-38cccad6-7634-4803-970e-f231698b1e81" acquired by "delete_volume" :: waited 0.041s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:02 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6875de43-61b9-4f95-a71f-0816617a8cd7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:02 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 Sep 23 00:22:02 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:03 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81" returned: 0 in 0.669s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:03 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81 Sep 23 00:22:03 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:03 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-38cccad6-7634-4803-970e-f231698b1e81" returned: 0 in 0.558s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Lock "cinder-quobyte-38cccad6-7634-4803-970e-f231698b1e81" released by "delete_volume" :: held 1.325s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:03 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Created reservations ['a1b0389d-b7e1-4063-b703-083dc77e9e79', '71dce6cb-b58f-4a08-83dc-5284f7508c88', '2414bfa1-c1ca-420b-a649-38bba2eeb326', '682453a6-b4e7-4ddc-b867-0c9c4b503e47'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:03 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:22:03 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:04 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.492s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:04 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:04 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Deleted volume successfully. Sep 23 00:22:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ec25d970-d328-4426-9c1a-6b61cfc3c416 tempest-VolumesImageMetadata-1138155269 None] Lock "cinder-38cccad6-7634-4803-970e-f231698b1e81-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Flow 'volume_create_manager' (917c66fd-b3f0-476f-b935-676475c9380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c182126-30f8-4566-9cff-a6cc3b46b03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c182126-30f8-4566-9cff-a6cc3b46b03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-343551789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d31a005-5685-403f-a17b-b187ea73f194,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ba07d3a1dce446288ec0e5b2616f35a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:07Z,use_quota=True,user_id='595694f68e454d4b94e5cf9c82e9896a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81117fb-eacf-4ea5-aa38-6fd73ba3e7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81117fb-eacf-4ea5-aa38-6fd73ba3e7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a25cb8-9e24-4f4d-8275-c49faa8c2f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a25cb8-9e24-4f4d-8275-c49faa8c2f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d31a005-5685-403f-a17b-b187ea73f194', 'volume_name': 'volume-5d31a005-5685-403f-a17b-b187ea73f194', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef0a3dc-c4bc-4835-b953-314f1498f6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef0a3dc-c4bc-4835-b953-314f1498f6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e523165-483d-484f-bd83-0653984fab6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:07 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Volume 5d31a005-5685-403f-a17b-b187ea73f194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d31a005-5685-403f-a17b-b187ea73f194', 'volume_size': 1} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-343551789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d31a005-5685-403f-a17b-b187ea73f194,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ba07d3a1dce446288ec0e5b2616f35a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:07Z,use_quota=True,user_id='595694f68e454d4b94e5cf9c82e9896a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Creating volume 5d31a005-5685-403f-a17b-b187ea73f194 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:07 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:22:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d31a005-5685-403f-a17b-b187ea73f194 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:07 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d31a005-5685-403f-a17b-b187ea73f194 1073741824 Sep 23 00:22:07 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:08 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d31a005-5685-403f-a17b-b187ea73f194 1073741824" returned: 0 in 0.724s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d31a005-5685-403f-a17b-b187ea73f194 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:08 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d31a005-5685-403f-a17b-b187ea73f194 Sep 23 00:22:08 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:08 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d31a005-5685-403f-a17b-b187ea73f194" returned: 0 in 0.333s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e523165-483d-484f-bd83-0653984fab6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d31a005-5685-403f-a17b-b187ea73f194', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f80be3c-2942-4c5a-8faa-6c4147339c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:08 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Volume volume-5d31a005-5685-403f-a17b-b187ea73f194 (5d31a005-5685-403f-a17b-b187ea73f194): created successfully Sep 23 00:22:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f80be3c-2942-4c5a-8faa-6c4147339c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Flow 'volume_create_manager' (917c66fd-b3f0-476f-b935-676475c9380b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:09 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4aaa9b23-928f-4831-a408-7e2f7f339560 tempest-VolumesListTestJSON-535536115 None] Created volume successfully. Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Flow 'volume_create_manager' (dd41dd9f-050a-4c2e-9808-fb60ab7f6b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc67366-f443-4755-9a1f-6b1d66c3e53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc67366-f443-4755-9a1f-6b1d66c3e53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1250613014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ba07d3a1dce446288ec0e5b2616f35a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:10Z,use_quota=True,user_id='595694f68e454d4b94e5cf9c82e9896a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a800184-664e-48c9-a99e-959063e38cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a800184-664e-48c9-a99e-959063e38cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5002d2e9-87cd-433b-84b8-1c9b03dd0180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5002d2e9-87cd-433b-84b8-1c9b03dd0180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce', 'volume_name': 'volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f526938-88fc-440b-a191-826ac79f6a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f526938-88fc-440b-a191-826ac79f6a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d84fd8ba-150c-41c4-8be9-223f58a65317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:10 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Volume 3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce', 'volume_size': 1} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1250613014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ba07d3a1dce446288ec0e5b2616f35a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:10Z,use_quota=True,user_id='595694f68e454d4b94e5cf9c82e9896a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Creating volume 3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:10 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:22:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:10 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce 1073741824 Sep 23 00:22:10 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:11 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce 1073741824" returned: 0 in 0.521s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:11 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce Sep 23 00:22:11 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:11 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce" returned: 0 in 0.330s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d84fd8ba-150c-41c4-8be9-223f58a65317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66c370a-2447-4285-988e-129387e7d480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Volume volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce (3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce): created successfully Sep 23 00:22:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66c370a-2447-4285-988e-129387e7d480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Flow 'volume_create_manager' (dd41dd9f-050a-4c2e-9808-fb60ab7f6b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:11 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-67e2a155-9722-40a3-9460-32539abdbf65 tempest-VolumesListTestJSON-535536115 None] Created volume successfully. Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Flow 'volume_create_manager' (6d9ac131-1506-4831-abff-c2a3a4e161de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a753e4-bc3f-4b55-8085-f18119e5dc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a753e4-bc3f-4b55-8085-f18119e5dc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1129453772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef7b1bc-a77b-449a-b49b-1c1774047f8a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ba07d3a1dce446288ec0e5b2616f35a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:14Z,use_quota=True,user_id='595694f68e454d4b94e5cf9c82e9896a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6963b677-392f-4498-83e1-6b8f8be491d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6963b677-392f-4498-83e1-6b8f8be491d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43664630-aece-4281-a01c-701025d49b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43664630-aece-4281-a01c-701025d49b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef7b1bc-a77b-449a-b49b-1c1774047f8a', 'volume_name': 'volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6d270a-fc14-4d52-aa67-eba7e8e1addf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6d270a-fc14-4d52-aa67-eba7e8e1addf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc50d622-ae01-4771-b090-45f9a1773c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:13 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Volume 2ef7b1bc-a77b-449a-b49b-1c1774047f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a', 'volume_size': 1} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1129453772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef7b1bc-a77b-449a-b49b-1c1774047f8a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ba07d3a1dce446288ec0e5b2616f35a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:14Z,use_quota=True,user_id='595694f68e454d4b94e5cf9c82e9896a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Creating volume 2ef7b1bc-a77b-449a-b49b-1c1774047f8a {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:13 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:22:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:13 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a 1073741824 Sep 23 00:22:13 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:14 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a 1073741824" returned: 0 in 0.752s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:14 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a Sep 23 00:22:14 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:14 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a" returned: 0 in 0.390s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc50d622-ae01-4771-b090-45f9a1773c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d3e84c-a9c6-472b-8ef1-b522886fef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:15 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Volume volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a (2ef7b1bc-a77b-449a-b49b-1c1774047f8a): created successfully Sep 23 00:22:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d3e84c-a9c6-472b-8ef1-b522886fef16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Flow 'volume_create_manager' (6d9ac131-1506-4831-abff-c2a3a4e161de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:15 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d05a6e5f-291f-4b45-9e92-4c8962fd464d tempest-VolumesListTestJSON-535536115 None] Created volume successfully. Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Flow 'volume_create_manager' (662a0d25-fe97-4831-9afc-39d6947fe59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad692fcb-6787-4e1c-ae9c-f9d69c2c0a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad692fcb-6787-4e1c-ae9c-f9d69c2c0a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-467561831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c528ed-f520-43b4-b945-a2e3662af4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73840b0186fa47a8a6d54e362c927873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:18Z,use_quota=True,user_id='6625cbe9b0e8401fb926c597da98d55a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c36974-29fa-45f2-baed-309a58984c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c36974-29fa-45f2-baed-309a58984c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd22be3-d9dc-4dfe-ab6f-8b1e227780ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd22be3-d9dc-4dfe-ab6f-8b1e227780ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8c528ed-f520-43b4-b945-a2e3662af4bf', 'volume_name': 'volume-f8c528ed-f520-43b4-b945-a2e3662af4bf', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17c2015-ad7c-41ce-91bc-1aa730f1a3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17c2015-ad7c-41ce-91bc-1aa730f1a3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f71fad-4b99-4120-a42f-7676694e3f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:17 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Volume f8c528ed-f520-43b4-b945-a2e3662af4bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8c528ed-f520-43b4-b945-a2e3662af4bf', 'volume_size': 1} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-467561831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c528ed-f520-43b4-b945-a2e3662af4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73840b0186fa47a8a6d54e362c927873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:18Z,use_quota=True,user_id='6625cbe9b0e8401fb926c597da98d55a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Creating volume f8c528ed-f520-43b4-b945-a2e3662af4bf {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:17 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:22:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8c528ed-f520-43b4-b945-a2e3662af4bf 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:18 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8c528ed-f520-43b4-b945-a2e3662af4bf 1073741824 Sep 23 00:22:18 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:18 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8c528ed-f520-43b4-b945-a2e3662af4bf 1073741824" returned: 0 in 0.816s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8c528ed-f520-43b4-b945-a2e3662af4bf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:18 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8c528ed-f520-43b4-b945-a2e3662af4bf Sep 23 00:22:18 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Acquiring lock "cinder-2ef7b1bc-a77b-449a-b49b-1c1774047f8a-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Lock "cinder-2ef7b1bc-a77b-449a-b49b-1c1774047f8a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Acquiring lock "cinder-quobyte-2ef7b1bc-a77b-449a-b49b-1c1774047f8a" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Lock "cinder-quobyte-2ef7b1bc-a77b-449a-b49b-1c1774047f8a" acquired by "delete_volume" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe80d88d-d416-4b28-96a2-6efa04082261]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:19 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8c528ed-f520-43b4-b945-a2e3662af4bf" returned: 0 in 0.339s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f71fad-4b99-4120-a42f-7676694e3f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8c528ed-f520-43b4-b945-a2e3662af4bf', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f43882-0904-444e-84e6-038c8984d097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:19 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Volume volume-f8c528ed-f520-43b4-b945-a2e3662af4bf (f8c528ed-f520-43b4-b945-a2e3662af4bf): created successfully Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f43882-0904-444e-84e6-038c8984d097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Flow 'volume_create_manager' (662a0d25-fe97-4831-9afc-39d6947fe59d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:19 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-88824ee7-ec1b-4ca4-a24d-b114ec89e86a tempest-AbsoluteLimitsTests-768496445 None] Created volume successfully. Sep 23 00:22:19 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a Sep 23 00:22:19 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:19 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a" returned: 0 in 0.545s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:19 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a Sep 23 00:22:19 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:20 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2ef7b1bc-a77b-449a-b49b-1c1774047f8a" returned: 0 in 0.394s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Lock "cinder-quobyte-2ef7b1bc-a77b-449a-b49b-1c1774047f8a" released by "delete_volume" :: held 1.009s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Created reservations ['d70b31ec-d9e5-4d44-b045-a71979a053aa', '0d17ffeb-ff7a-4f4a-98c7-84c4722922a2', '88445daf-f51a-46df-98cc-82d9da43cf1e', '9ff283ba-a32c-4706-a43e-c6d18a110354'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Acquiring lock "cinder-f8c528ed-f520-43b4-b945-a2e3662af4bf-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Lock "cinder-f8c528ed-f520-43b4-b945-a2e3662af4bf-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:20 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:22:20 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Acquiring lock "cinder-quobyte-f8c528ed-f520-43b4-b945-a2e3662af4bf" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Lock "cinder-quobyte-f8c528ed-f520-43b4-b945-a2e3662af4bf" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a973f6e-45bc-4838-8c6b-946f5f653331]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8c528ed-f520-43b4-b945-a2e3662af4bf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:20 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8c528ed-f520-43b4-b945-a2e3662af4bf Sep 23 00:22:20 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:20 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.437s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Deleted volume successfully. Sep 23 00:22:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1239a2b1-4152-43f6-9a94-2adadb2dddce tempest-VolumesListTestJSON-535536115 None] Lock "cinder-2ef7b1bc-a77b-449a-b49b-1c1774047f8a-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:21 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8c528ed-f520-43b4-b945-a2e3662af4bf" returned: 0 in 0.645s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8c528ed-f520-43b4-b945-a2e3662af4bf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:21 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8c528ed-f520-43b4-b945-a2e3662af4bf Sep 23 00:22:21 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Acquiring lock "cinder-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Lock "cinder-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Acquiring lock "cinder-quobyte-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Lock "cinder-quobyte-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:21 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad21256f-e5ed-40b8-ae08-477cbfdb75f1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:21 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f8c528ed-f520-43b4-b945-a2e3662af4bf" returned: 0 in 0.478s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Lock "cinder-quobyte-f8c528ed-f520-43b4-b945-a2e3662af4bf" released by "delete_volume" :: held 1.206s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:21 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Created reservations ['ad794883-2d62-4edc-871e-b84ceb50ac0c', 'df2acd1e-00f2-4b1f-b9b6-7b6406a65a35', 'bdadaadd-5f20-4df8-ba18-b94e40509174', '9c0e2311-bc2d-4561-9d10-8fa72176ef20'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:21 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce Sep 23 00:22:21 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:22 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:22:22 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce" returned: 0 in 0.664s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:22 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:22 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce Sep 23 00:22:22 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:22 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.485s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:22 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Deleted volume successfully. Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-30617f39-5f62-4c75-aec4-711c7d4ca53a tempest-AbsoluteLimitsTests-768496445 None] Lock "cinder-f8c528ed-f520-43b4-b945-a2e3662af4bf-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:22 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce" returned: 0 in 0.420s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Lock "cinder-quobyte-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce" released by "delete_volume" :: held 1.154s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:22 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Created reservations ['3f72eb7e-61a4-4e1c-8909-f314975dafc3', 'f7c815cb-41df-498a-b035-88974c6cc083', '9cccb2b3-2a33-46de-ba57-3e8f00efc79c', '6edaa87e-37be-4b31-9398-ee793dd2d2c4'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:23 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:22:23 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:23 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.379s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:23 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Deleted volume successfully. Sep 23 00:22:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ab45e7f9-ac25-4ee1-8e15-0085ab44e755 tempest-VolumesListTestJSON-535536115 None] Lock "cinder-3f92e86a-5e91-48ee-8fbb-eb4fdb2dbfce-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Acquiring lock "cinder-5d31a005-5685-403f-a17b-b187ea73f194-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Lock "cinder-5d31a005-5685-403f-a17b-b187ea73f194-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Acquiring lock "cinder-quobyte-5d31a005-5685-403f-a17b-b187ea73f194" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Lock "cinder-quobyte-5d31a005-5685-403f-a17b-b187ea73f194" acquired by "delete_volume" :: waited 0.041s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:24 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9c7bfb-3098-471e-ba79-bc26017e489c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d31a005-5685-403f-a17b-b187ea73f194 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:24 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d31a005-5685-403f-a17b-b187ea73f194 Sep 23 00:22:24 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:24 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d31a005-5685-403f-a17b-b187ea73f194" returned: 0 in 0.629s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d31a005-5685-403f-a17b-b187ea73f194 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:24 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d31a005-5685-403f-a17b-b187ea73f194 Sep 23 00:22:24 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:25 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d31a005-5685-403f-a17b-b187ea73f194" returned: 0 in 0.349s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Lock "cinder-quobyte-5d31a005-5685-403f-a17b-b187ea73f194" released by "delete_volume" :: held 1.068s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:25 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Created reservations ['5989c1d4-b339-4d63-b3ff-11365d918ae7', '6e3338d2-e0ff-4acf-b34e-fa189836221f', '9c287d7a-3d11-49dc-9741-cea55376bbd1', '09ac95e6-82e4-4e23-9490-2426054bb8c3'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:25 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:22:25 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:26 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.497s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:26 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:26 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Deleted volume successfully. Sep 23 00:22:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-51585c03-52b6-41df-913c-8a23530061f9 tempest-VolumesListTestJSON-535536115 None] Lock "cinder-5d31a005-5685-403f-a17b-b187ea73f194-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:35 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=88,cinder:INSERT=29,cinder:DELETE=6,cinder:SELECT=72 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:36 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=70,cinder:UPDATE=93,cinder:INSERT=24,cinder:DELETE=10 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:36 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Flow 'volume_create_manager' (65949b40-ec70-49cb-adf2-c3f5605c69dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f649a6e7-2287-40b4-8ed1-aceb9361f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f649a6e7-2287-40b4-8ed1-aceb9361f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-494722837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b369495b-9bd3-4c46-a0dd-65b527d1da20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffafa2486a1a4b7393d5f22fa83f861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:37Z,use_quota=True,user_id='10fa04093c8c40388d60da6956a00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08075b8d-d8f0-4cb1-8eb3-459cc72a2764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08075b8d-d8f0-4cb1-8eb3-459cc72a2764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4f0064-34a7-4ec5-a02b-9bb5105fc9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4f0064-34a7-4ec5-a02b-9bb5105fc9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b369495b-9bd3-4c46-a0dd-65b527d1da20', 'volume_name': 'volume-b369495b-9bd3-4c46-a0dd-65b527d1da20', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdd3cf3-c339-484b-822c-47651b24a894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdd3cf3-c339-484b-822c-47651b24a894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea02ed3-ed2f-4dc0-844e-2c1eb8054330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:37 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Volume b369495b-9bd3-4c46-a0dd-65b527d1da20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b369495b-9bd3-4c46-a0dd-65b527d1da20', 'volume_size': 1} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-494722837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b369495b-9bd3-4c46-a0dd-65b527d1da20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffafa2486a1a4b7393d5f22fa83f861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:37Z,use_quota=True,user_id='10fa04093c8c40388d60da6956a00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Creating volume b369495b-9bd3-4c46-a0dd-65b527d1da20 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:37 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b369495b-9bd3-4c46-a0dd-65b527d1da20 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:37 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b369495b-9bd3-4c46-a0dd-65b527d1da20 1073741824 Sep 23 00:22:37 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:37 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b369495b-9bd3-4c46-a0dd-65b527d1da20 1073741824" returned: 0 in 0.776s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b369495b-9bd3-4c46-a0dd-65b527d1da20 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:38 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b369495b-9bd3-4c46-a0dd-65b527d1da20 Sep 23 00:22:38 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:38 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b369495b-9bd3-4c46-a0dd-65b527d1da20" returned: 0 in 0.420s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea02ed3-ed2f-4dc0-844e-2c1eb8054330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b369495b-9bd3-4c46-a0dd-65b527d1da20', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413ed2a5-2152-4d0a-b902-3e16b41bac92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:38 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Volume volume-b369495b-9bd3-4c46-a0dd-65b527d1da20 (b369495b-9bd3-4c46-a0dd-65b527d1da20): created successfully Sep 23 00:22:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413ed2a5-2152-4d0a-b902-3e16b41bac92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Flow 'volume_create_manager' (65949b40-ec70-49cb-adf2-c3f5605c69dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:38 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-439b20b3-9339-48bc-8772-f873ebdd139d tempest-VolumesTransfersV355Test-485230241 None] Created volume successfully. Sep 23 00:22:40 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a0ccebea-e648-4aeb-a3f6-284d69dc60b4 tempest-VolumesTransfersV355Test-2063109231 None] Transfer volume completed successfully. Sep 23 00:22:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Acquiring lock "cinder-b369495b-9bd3-4c46-a0dd-65b527d1da20-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Lock "cinder-b369495b-9bd3-4c46-a0dd-65b527d1da20-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Acquiring lock "cinder-quobyte-b369495b-9bd3-4c46-a0dd-65b527d1da20" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Lock "cinder-quobyte-b369495b-9bd3-4c46-a0dd-65b527d1da20" acquired by "delete_volume" :: waited 0.041s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:41 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[49591a30-5748-4048-877a-9f84c658c543]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b369495b-9bd3-4c46-a0dd-65b527d1da20 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:41 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b369495b-9bd3-4c46-a0dd-65b527d1da20 Sep 23 00:22:41 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:41 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b369495b-9bd3-4c46-a0dd-65b527d1da20" returned: 0 in 0.499s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b369495b-9bd3-4c46-a0dd-65b527d1da20 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:41 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b369495b-9bd3-4c46-a0dd-65b527d1da20 Sep 23 00:22:41 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:41 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b369495b-9bd3-4c46-a0dd-65b527d1da20" returned: 0 in 0.443s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Lock "cinder-quobyte-b369495b-9bd3-4c46-a0dd-65b527d1da20" released by "delete_volume" :: held 1.020s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:42 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Created reservations ['269123ae-decf-406f-b6eb-d077b812ab5a', 'b98debc2-0393-4d87-ade2-2a09ab1a06bd', 'c03a20a9-dee0-4240-916f-e8fff234c68d', 'ff29af39-4d22-459e-b8ce-547b53a7ca98'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:42 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:22:42 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:42 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.337s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:42 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:42 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Deleted volume successfully. Sep 23 00:22:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-91278b21-ed7c-4f44-9470-a25ca390e121 tempest-VolumesTransfersV355Test-330662307 None] Lock "cinder-b369495b-9bd3-4c46-a0dd-65b527d1da20-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:43 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Flow 'volume_create_manager' (e80e21b5-8994-456c-9dfb-9191ee8a1dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2e2054-889d-4474-973f-6bc706ae2013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2e2054-889d-4474-973f-6bc706ae2013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-748226360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4fad1f-9b1b-4213-b46e-806a656a0257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffafa2486a1a4b7393d5f22fa83f861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:44Z,use_quota=True,user_id='10fa04093c8c40388d60da6956a00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691fe969-b90a-4bf7-ae80-121496b8b10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691fe969-b90a-4bf7-ae80-121496b8b10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7142deaf-1a4c-4f8d-ab7c-0f48221020e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7142deaf-1a4c-4f8d-ab7c-0f48221020e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad4fad1f-9b1b-4213-b46e-806a656a0257', 'volume_name': 'volume-ad4fad1f-9b1b-4213-b46e-806a656a0257', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c5c960-2f59-41af-9d6c-9ef4940306c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c5c960-2f59-41af-9d6c-9ef4940306c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a736c948-365c-45d6-a963-b772e8bb523a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:44 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Volume ad4fad1f-9b1b-4213-b46e-806a656a0257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad4fad1f-9b1b-4213-b46e-806a656a0257', 'volume_size': 1} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-748226360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4fad1f-9b1b-4213-b46e-806a656a0257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffafa2486a1a4b7393d5f22fa83f861e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:44Z,use_quota=True,user_id='10fa04093c8c40388d60da6956a00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Creating volume ad4fad1f-9b1b-4213-b46e-806a656a0257 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:44 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ad4fad1f-9b1b-4213-b46e-806a656a0257 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:44 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ad4fad1f-9b1b-4213-b46e-806a656a0257 1073741824 Sep 23 00:22:44 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:44 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ad4fad1f-9b1b-4213-b46e-806a656a0257 1073741824" returned: 0 in 0.742s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ad4fad1f-9b1b-4213-b46e-806a656a0257 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:44 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ad4fad1f-9b1b-4213-b46e-806a656a0257 Sep 23 00:22:44 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:45 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:22:45 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:45 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ad4fad1f-9b1b-4213-b46e-806a656a0257" returned: 0 in 0.464s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a736c948-365c-45d6-a963-b772e8bb523a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad4fad1f-9b1b-4213-b46e-806a656a0257', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f18cfb-90a7-4744-a409-7c461daaccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:45 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.507s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:45 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Volume volume-ad4fad1f-9b1b-4213-b46e-806a656a0257 (ad4fad1f-9b1b-4213-b46e-806a656a0257): created successfully Sep 23 00:22:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f18cfb-90a7-4744-a409-7c461daaccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Flow 'volume_create_manager' (e80e21b5-8994-456c-9dfb-9191ee8a1dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:22:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:22:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:22:45 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-8e6f5bc5-0e34-4b02-8534-cd86a2a51400 tempest-VolumesTransfersV355Test-485230241 None] Created volume successfully. Sep 23 00:22:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Acquiring lock "cinder-ad4fad1f-9b1b-4213-b46e-806a656a0257-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Lock "cinder-ad4fad1f-9b1b-4213-b46e-806a656a0257-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Acquiring lock "cinder-quobyte-ad4fad1f-9b1b-4213-b46e-806a656a0257" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Lock "cinder-quobyte-ad4fad1f-9b1b-4213-b46e-806a656a0257" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:46 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b574ee7-921e-46d7-97a0-8d6e3f53c800]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ad4fad1f-9b1b-4213-b46e-806a656a0257 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:46 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ad4fad1f-9b1b-4213-b46e-806a656a0257 Sep 23 00:22:46 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:47 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ad4fad1f-9b1b-4213-b46e-806a656a0257" returned: 0 in 0.506s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ad4fad1f-9b1b-4213-b46e-806a656a0257 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:47 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ad4fad1f-9b1b-4213-b46e-806a656a0257 Sep 23 00:22:47 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:47 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ad4fad1f-9b1b-4213-b46e-806a656a0257" returned: 0 in 0.493s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Lock "cinder-quobyte-ad4fad1f-9b1b-4213-b46e-806a656a0257" released by "delete_volume" :: held 1.065s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:47 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Created reservations ['84ebd8cd-3875-45a6-886f-8f33ad067214', 'ae765783-ef15-4792-a0a8-bd093fee9b1b', '4ddf29b1-0389-4e9b-90d6-94b3985df2fc', '1f75ff77-d78b-4361-b3a9-c00c18c04110'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:22:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:48 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:22:48 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:48 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.393s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:48 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:48 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Deleted volume successfully. Sep 23 00:22:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-75057fd1-eafd-4b49-9441-41683ab200ee tempest-VolumesTransfersV355Test-330662307 None] Lock "cinder-ad4fad1f-9b1b-4213-b46e-806a656a0257-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:57 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:58 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=25,cinder:SELECT=14,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Flow 'volume_create_manager' (e15bd56d-6658-43c2-a9cd-06c457ce2b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbeae98-b972-4f91-9e05-c8f11a83ef61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbeae98-b972-4f91-9e05-c8f11a83ef61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-66291390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92cbe93-74a6-413d-b359-c7800c3875c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a990e43b71444d4907dce1e22e3e692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:03Z,use_quota=True,user_id='ef1376b04bbf4ad1b01cdf6990f9807a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dddfc81-db36-4df7-befd-462722a77be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dddfc81-db36-4df7-befd-462722a77be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626db5d4-9f29-40ab-b194-3f2d2662fdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626db5d4-9f29-40ab-b194-3f2d2662fdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd92cbe93-74a6-413d-b359-c7800c3875c3', 'volume_name': 'volume-d92cbe93-74a6-413d-b359-c7800c3875c3', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8b355e-541a-47da-bceb-349e719d5de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8b355e-541a-47da-bceb-349e719d5de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417cd7f2-294b-415e-bead-919dc20eeb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:03 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Volume d92cbe93-74a6-413d-b359-c7800c3875c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d92cbe93-74a6-413d-b359-c7800c3875c3', 'volume_size': 1} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-66291390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d92cbe93-74a6-413d-b359-c7800c3875c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a990e43b71444d4907dce1e22e3e692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:03Z,use_quota=True,user_id='ef1376b04bbf4ad1b01cdf6990f9807a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Creating volume d92cbe93-74a6-413d-b359-c7800c3875c3 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:03 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:23:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d92cbe93-74a6-413d-b359-c7800c3875c3 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:03 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d92cbe93-74a6-413d-b359-c7800c3875c3 1073741824 Sep 23 00:23:03 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Flow 'volume_create_manager' (99596bac-b396-426a-9468-6c19f8848136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0d1c56-2713-4cc7-8490-58c3fcf24c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0d1c56-2713-4cc7-8490-58c3fcf24c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2075095962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1263ec-3199-41b0-90e9-2798b9c02099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a990e43b71444d4907dce1e22e3e692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:04Z,use_quota=True,user_id='ef1376b04bbf4ad1b01cdf6990f9807a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f84c0a-df6e-4f0e-8bf4-16f829fb26ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f84c0a-df6e-4f0e-8bf4-16f829fb26ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13d2eb6-e668-4987-b7d1-4a0a414747cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13d2eb6-e668-4987-b7d1-4a0a414747cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f1263ec-3199-41b0-90e9-2798b9c02099', 'volume_name': 'volume-7f1263ec-3199-41b0-90e9-2798b9c02099', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cd9371-821f-452c-97bf-0b716fdaf018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cd9371-821f-452c-97bf-0b716fdaf018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bb2051-8a15-4d6a-a14c-8680321c0879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:04 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Volume 7f1263ec-3199-41b0-90e9-2798b9c02099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f1263ec-3199-41b0-90e9-2798b9c02099', 'volume_size': 1} Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:04 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d92cbe93-74a6-413d-b359-c7800c3875c3 1073741824" returned: 0 in 1.177s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d92cbe93-74a6-413d-b359-c7800c3875c3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:04 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d92cbe93-74a6-413d-b359-c7800c3875c3 Sep 23 00:23:04 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:05 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d92cbe93-74a6-413d-b359-c7800c3875c3" returned: 0 in 0.588s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2075095962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1263ec-3199-41b0-90e9-2798b9c02099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a990e43b71444d4907dce1e22e3e692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:04Z,use_quota=True,user_id='ef1376b04bbf4ad1b01cdf6990f9807a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Creating volume 7f1263ec-3199-41b0-90e9-2798b9c02099 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:05 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f1263ec-3199-41b0-90e9-2798b9c02099 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:05 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f1263ec-3199-41b0-90e9-2798b9c02099 1073741824 Sep 23 00:23:05 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417cd7f2-294b-415e-bead-919dc20eeb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d92cbe93-74a6-413d-b359-c7800c3875c3', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d038d17a-9699-48e8-a78f-d3d69be2ecf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:05 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Volume volume-d92cbe93-74a6-413d-b359-c7800c3875c3 (d92cbe93-74a6-413d-b359-c7800c3875c3): created successfully Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d038d17a-9699-48e8-a78f-d3d69be2ecf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Flow 'volume_create_manager' (e15bd56d-6658-43c2-a9cd-06c457ce2b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ee2bc5cc-e3aa-44aa-9850-7b679777e1db tempest-TestServerVolumeAttachmentScenario-271356783 None] Created volume successfully. Sep 23 00:23:06 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f1263ec-3199-41b0-90e9-2798b9c02099 1073741824" returned: 0 in 0.942s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f1263ec-3199-41b0-90e9-2798b9c02099 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:06 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f1263ec-3199-41b0-90e9-2798b9c02099 Sep 23 00:23:06 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:06 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f1263ec-3199-41b0-90e9-2798b9c02099" returned: 0 in 0.378s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bb2051-8a15-4d6a-a14c-8680321c0879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1263ec-3199-41b0-90e9-2798b9c02099', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53bee2b-4f80-4550-b773-0b24fd792db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:06 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Volume volume-7f1263ec-3199-41b0-90e9-2798b9c02099 (7f1263ec-3199-41b0-90e9-2798b9c02099): created successfully Sep 23 00:23:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53bee2b-4f80-4550-b773-0b24fd792db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Flow 'volume_create_manager' (99596bac-b396-426a-9468-6c19f8848136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:06 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7f9d54bd-9eed-442f-baa7-69de2e7fe3c0 tempest-TestServerVolumeAttachmentScenario-271356783 None] Created volume successfully. Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Flow 'volume_create_manager' (8beae387-a0bd-4c24-acc6-b6e38f521c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dccf00f-28b6-4a41-8aac-4316cd64873d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dccf00f-28b6-4a41-8aac-4316cd64873d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1996994008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8606ba7c-0955-4f0e-8d11-ceb115db13c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1e9ba753e84864aea484b007cb6e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:11Z,use_quota=True,user_id='a5cf7d8011ef47268eab175b9d538bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77872f1-4691-4943-abbb-83dc6d69ae69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77872f1-4691-4943-abbb-83dc6d69ae69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5681e76f-c574-4e5d-968c-8d8e8afbdd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5681e76f-c574-4e5d-968c-8d8e8afbdd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8606ba7c-0955-4f0e-8d11-ceb115db13c8', 'volume_name': 'volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba0be39-1f4b-46f4-bce1-411701b16272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba0be39-1f4b-46f4-bce1-411701b16272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701aa859-c046-4df5-9272-10dc6b2e94e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Volume 8606ba7c-0955-4f0e-8d11-ceb115db13c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8', 'volume_size': 1} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1996994008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8606ba7c-0955-4f0e-8d11-ceb115db13c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1e9ba753e84864aea484b007cb6e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:11Z,use_quota=True,user_id='a5cf7d8011ef47268eab175b9d538bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Creating volume 8606ba7c-0955-4f0e-8d11-ceb115db13c8 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:11 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:23:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:11 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 1073741824 Sep 23 00:23:11 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:12 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 1073741824" returned: 0 in 0.776s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:12 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 Sep 23 00:23:12 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:13 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8" returned: 0 in 0.459s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701aa859-c046-4df5-9272-10dc6b2e94e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7b0ff2-484a-44dd-be61-dbaa84d5c954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:13 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Volume volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 (8606ba7c-0955-4f0e-8d11-ceb115db13c8): created successfully Sep 23 00:23:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7b0ff2-484a-44dd-be61-dbaa84d5c954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Flow 'volume_create_manager' (8beae387-a0bd-4c24-acc6-b6e38f521c69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:13 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-960930f7-ead0-4c9a-8be9-321f9123be1b tempest-TestImageHashVerification-401802276 None] Created volume successfully. Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Flow 'volume_create_manager' (e25e1c38-922b-4b14-8eed-69bacf2b4729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7512280d-7549-44c0-8c08-13c1db91f7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7512280d-7549-44c0-8c08-13c1db91f7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1068265503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a529cb-b976-4e3f-a561-f28625a5e763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf45902e34a47e99eab929da21772f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:14Z,use_quota=True,user_id='2b5269b4913d4639acd4d8cbe2715a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cd9ab8-3e67-4c28-9ebf-5d2a89e733b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cd9ab8-3e67-4c28-9ebf-5d2a89e733b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f12269a-ae93-4575-96fe-8e49cc13083c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f12269a-ae93-4575-96fe-8e49cc13083c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8a529cb-b976-4e3f-a561-f28625a5e763', 'volume_name': 'volume-b8a529cb-b976-4e3f-a561-f28625a5e763', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d57fe500-2b82-40e0-82b0-7788c52a74ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d57fe500-2b82-40e0-82b0-7788c52a74ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0719051c-4dd3-4515-87d0-0500468cd55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:14 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Volume b8a529cb-b976-4e3f-a561-f28625a5e763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8a529cb-b976-4e3f-a561-f28625a5e763', 'volume_size': 1} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1068265503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a529cb-b976-4e3f-a561-f28625a5e763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf45902e34a47e99eab929da21772f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:14Z,use_quota=True,user_id='2b5269b4913d4639acd4d8cbe2715a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Creating volume b8a529cb-b976-4e3f-a561-f28625a5e763 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:14 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:23:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b8a529cb-b976-4e3f-a561-f28625a5e763 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:14 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b8a529cb-b976-4e3f-a561-f28625a5e763 1073741824 Sep 23 00:23:14 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:15 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b8a529cb-b976-4e3f-a561-f28625a5e763 1073741824" returned: 0 in 1.205s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b8a529cb-b976-4e3f-a561-f28625a5e763 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:16 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b8a529cb-b976-4e3f-a561-f28625a5e763 Sep 23 00:23:16 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:16 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b8a529cb-b976-4e3f-a561-f28625a5e763" returned: 0 in 0.364s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.739s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0719051c-4dd3-4515-87d0-0500468cd55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8a529cb-b976-4e3f-a561-f28625a5e763', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf7ef73-7afb-4d17-a0fc-8c8ff515e698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:16 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be0f1ed-06fb-42d7-8e23-82e09c2165a6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:16 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Volume volume-b8a529cb-b976-4e3f-a561-f28625a5e763 (b8a529cb-b976-4e3f-a561-f28625a5e763): created successfully Sep 23 00:23:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf7ef73-7afb-4d17-a0fc-8c8ff515e698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Flow 'volume_create_manager' (e25e1c38-922b-4b14-8eed-69bacf2b4729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-33ef72d7-58a7-49b7-bf10-22a66076bd69 tempest-VolumesTransfersV357Test-187581814 None] Created volume successfully. Sep 23 00:23:16 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 Sep 23 00:23:16 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:17 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8" returned: 0 in 1.031s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:17 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e1a9a6-d90c-4a35-ac15-28891a0f5e29]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:17 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 Sep 23 00:23:17 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Flow 'volume_create_manager' (d3de5132-a951-423a-bf40-77efc0b7c05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc40acd-b449-4df1-b200-deafa1627d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc40acd-b449-4df1-b200-deafa1627d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1561663136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd7d4481f343a2b5e3bb77fd219ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:18Z,use_quota=True,user_id='0c9bce053578439c9b30bfe2be0c7f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bc8bd9-b365-4a2a-8dce-684c03b8e1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bc8bd9-b365-4a2a-8dce-684c03b8e1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe8036d-15d1-4abf-8311-3a4b05ee222d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe8036d-15d1-4abf-8311-3a4b05ee222d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb', 'volume_name': 'volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01129f9-4c53-42a9-a20b-ebfe9b6a7caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01129f9-4c53-42a9-a20b-ebfe9b6a7caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4e17bd-f816-4741-8cf1-12c1eac0b1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:18 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Volume 2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb', 'volume_size': 1} Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:18 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8" returned: 0 in 1.061s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 /opt/stack/data/cinder/conversion/8606ba7c-0955-4f0e-8d11-ceb115db13c8.temp_image.ae3d7063-ef80-4c04-9a9f-e73f0c38fcdbvlqybz5_.img {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:18 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 /opt/stack/data/cinder/conversion/8606ba7c-0955-4f0e-8d11-ceb115db13c8.temp_image.ae3d7063-ef80-4c04-9a9f-e73f0c38fcdbvlqybz5_.img Sep 23 00:23:18 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:18 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4d9d1284-fa07-435b-97af-7726ce9cd57e tempest-VolumesTransfersV357Test-1849506995 None] Transfer volume completed successfully. Sep 23 00:23:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Acquiring lock "cinder-b8a529cb-b976-4e3f-a561-f28625a5e763-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Lock "cinder-b8a529cb-b976-4e3f-a561-f28625a5e763-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Acquiring lock "cinder-quobyte-b8a529cb-b976-4e3f-a561-f28625a5e763" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Lock "cinder-quobyte-b8a529cb-b976-4e3f-a561-f28625a5e763" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:21 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[02181aa8-05fa-49a8-b82f-b7af857cc2df]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b8a529cb-b976-4e3f-a561-f28625a5e763 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:21 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b8a529cb-b976-4e3f-a561-f28625a5e763 Sep 23 00:23:21 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:22 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b8a529cb-b976-4e3f-a561-f28625a5e763" returned: 0 in 1.194s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b8a529cb-b976-4e3f-a561-f28625a5e763 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:22 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b8a529cb-b976-4e3f-a561-f28625a5e763 Sep 23 00:23:22 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:23 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b8a529cb-b976-4e3f-a561-f28625a5e763" returned: 0 in 0.936s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Lock "cinder-quobyte-b8a529cb-b976-4e3f-a561-f28625a5e763" released by "delete_volume" :: held 2.301s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:23 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Created reservations ['3dbe5e1f-3ead-4e45-83fa-b1be49b44797', 'faf9fffc-fc86-4782-97db-80c2d8ca2021', '1b9344b7-74f6-4354-b576-4c627291a20b', 'db3da69d-0d08-4a48-abbc-2dd21c76ab0d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:23 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:23:23 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:24 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 1.057s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:24 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:24 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Deleted volume successfully. Sep 23 00:23:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a08bdb7d-330f-4ef3-b270-06f3db8190fe tempest-VolumesTransfersV357Test-528191422 None] Lock "cinder-b8a529cb-b976-4e3f-a561-f28625a5e763-delete_volume" released by "delete_volume" :: held 4.175s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:26 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:23:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Flow 'volume_create_manager' (ebcf5799-d976-46ac-837a-b4ec936dabb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99215d3-dd67-4643-9940-52c2f511c42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99215d3-dd67-4643-9940-52c2f511c42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-929669194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8816449-cd9a-49c4-bf6d-7b94e55bb357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf45902e34a47e99eab929da21772f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:26Z,use_quota=True,user_id='2b5269b4913d4639acd4d8cbe2715a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08ecb23-7097-44c6-b34c-28d278d037d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08ecb23-7097-44c6-b34c-28d278d037d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cabeb7b-8a9c-4dce-99af-fb560d63fa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cabeb7b-8a9c-4dce-99af-fb560d63fa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8816449-cd9a-49c4-bf6d-7b94e55bb357', 'volume_name': 'volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66d039e-59cd-4d60-b8d6-601c28000901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66d039e-59cd-4d60-b8d6-601c28000901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86286c6-0d36-4a99-858f-764cadbc5725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:26 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Volume a8816449-cd9a-49c4-bf6d-7b94e55bb357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357', 'volume_size': 1} Sep 23 00:23:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:29 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 /opt/stack/data/cinder/conversion/8606ba7c-0955-4f0e-8d11-ceb115db13c8.temp_image.ae3d7063-ef80-4c04-9a9f-e73f0c38fcdbvlqybz5_.img" returned: 0 in 10.844s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:29 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df6ef42-f70b-49d4-8951-d146be31c888]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:29 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 Sep 23 00:23:29 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:30 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8" returned: 0 in 1.447s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:30 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8, size 1024.00 MB, duration 10.85 sec, destination /opt/stack/data/cinder/conversion/8606ba7c-0955-4f0e-8d11-ceb115db13c8.temp_image.ae3d7063-ef80-4c04-9a9f-e73f0c38fcdbvlqybz5_.img {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:23:30 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] Converted 1024.00 MB image at 94.42 MB/s Sep 23 00:23:30 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] ae3d7063-ef80-4c04-9a9f-e73f0c38fcdb was raw, no need to convert to raw {{(pid=86481) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 00:23:40 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=19,cinder:UPDATE=23,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:40 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=16,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=4 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:23:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:45 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:23:45 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:45 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.423s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:23:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:23:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:23:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.473s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] Uploaded volume to glance image-id: ae3d7063-ef80-4c04-9a9f-e73f0c38fcdb. {{(pid=86481) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:23:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 37.361s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1561663136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd7d4481f343a2b5e3bb77fd219ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:18Z,use_quota=True,user_id='0c9bce053578439c9b30bfe2be0c7f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Creating volume 2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:55 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:23:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:55 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb 1073741824 Sep 23 00:23:55 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:55 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-45104481-d1e1-4a92-93c0-772362d85518 tempest-TestImageHashVerification-401802276 None] Copy volume to image completed successfully. Sep 23 00:23:56 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb 1073741824" returned: 0 in 0.620s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:56 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb Sep 23 00:23:56 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:56 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Acquiring lock "cinder-8606ba7c-0955-4f0e-8d11-ceb115db13c8-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb" returned: 0 in 0.353s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.059s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-929669194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8816449-cd9a-49c4-bf6d-7b94e55bb357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaf45902e34a47e99eab929da21772f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:23:26Z,use_quota=True,user_id='2b5269b4913d4639acd4d8cbe2715a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Creating volume a8816449-cd9a-49c4-bf6d-7b94e55bb357 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:23:56 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4e17bd-f816-4741-8cf1-12c1eac0b1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c37b1d5-da3f-4249-8024-fbc95adb4a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:56 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357 1073741824 Sep 23 00:23:56 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Lock "cinder-8606ba7c-0955-4f0e-8d11-ceb115db13c8-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:56 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Volume volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb (2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb): created successfully Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c37b1d5-da3f-4249-8024-fbc95adb4a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Flow 'volume_create_manager' (d3de5132-a951-423a-bf40-77efc0b7c05a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:57 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-229cb411-edad-4a9b-8a73-e0c28563552a tempest-VolumesActionsTest-1046191595 None] Created volume successfully. Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Acquiring lock "cinder-quobyte-8606ba7c-0955-4f0e-8d11-ceb115db13c8" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Lock "cinder-quobyte-8606ba7c-0955-4f0e-8d11-ceb115db13c8" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b67591-0a97-419a-a150-34f04f821a56]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:57 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 Sep 23 00:23:57 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:57 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357 1073741824" returned: 0 in 0.587s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:57 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357 Sep 23 00:23:57 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:57 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8" returned: 0 in 0.526s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:57 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8 Sep 23 00:23:57 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:57 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357" returned: 0 in 0.291s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a8fbb727-b1ca-424a-b7c4-f07735f4ef1c tempest-VolumesActionsTest-1046191595 None] Acquiring lock "cinder-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb" by "attach_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86286c6-0d36-4a99-858f-764cadbc5725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8788c4cd-a421-4c43-b885-ab1e3a32850d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a8fbb727-b1ca-424a-b7c4-f07735f4ef1c tempest-VolumesActionsTest-1046191595 None] Lock "cinder-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb" acquired by "attach_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:57 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Volume volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357 (a8816449-cd9a-49c4-bf6d-7b94e55bb357): created successfully Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8788c4cd-a421-4c43-b885-ab1e3a32850d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:23:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Flow 'volume_create_manager' (ebcf5799-d976-46ac-837a-b4ec936dabb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:23:57 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ecd2771b-f998-4b80-850d-e9744988f94e tempest-VolumesTransfersV357Test-187581814 None] Created volume successfully. Sep 23 00:23:58 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a8fbb727-b1ca-424a-b7c4-f07735f4ef1c tempest-VolumesActionsTest-1046191595 None] Attaching volume 2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb to instance ad6e38ca-b33d-4952-842c-86c1d4fa9a6d at mountpoint /dev/vdb on host None. Sep 23 00:23:58 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8606ba7c-0955-4f0e-8d11-ceb115db13c8" returned: 0 in 0.382s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Lock "cinder-quobyte-8606ba7c-0955-4f0e-8d11-ceb115db13c8" released by "delete_volume" :: held 0.979s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:58 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a8fbb727-b1ca-424a-b7c4-f07735f4ef1c tempest-VolumesActionsTest-1046191595 None] Attach volume completed successfully. Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a8fbb727-b1ca-424a-b7c4-f07735f4ef1c tempest-VolumesActionsTest-1046191595 None] Lock "cinder-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb" released by "attach_volume" :: held 0.165s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-34fc6ee8-41e5-4ddf-bf93-0388a01459a4 req-bbf87eaf-3684-4366-9917-548c740fcd6d tempest-TestServerVolumeAttachmentScenario-271356783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-34fc6ee8-41e5-4ddf-bf93-0388a01459a4 req-bbf87eaf-3684-4366-9917-548c740fcd6d tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-34fc6ee8-41e5-4ddf-bf93-0388a01459a4 req-bbf87eaf-3684-4366-9917-548c740fcd6d tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Created reservations ['66d52ce7-e3b6-4ce7-8a6d-f4a23e66db14', '94cf8579-c5a2-485b-8a99-0c528214c39a', 'ea93ac02-5d6b-499f-9f53-96a9b33fe065', 'cd1d4726-03fe-41d8-941d-ba63d9368d18'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-34fc6ee8-41e5-4ddf-bf93-0388a01459a4 req-bbf87eaf-3684-4366-9917-548c740fcd6d tempest-TestServerVolumeAttachmentScenario-271356783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-d92cbe93-74a6-413d-b359-c7800c3875c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ad896cd-0fc3-4739-a3a4-4e4b84fa286b', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:23:58 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-34fc6ee8-41e5-4ddf-bf93-0388a01459a4 req-bbf87eaf-3684-4366-9917-548c740fcd6d tempest-TestServerVolumeAttachmentScenario-271356783 None] attachment_update completed successfully. Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:58 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:23:58 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:58 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.372s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:58 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Deleted volume successfully. Sep 23 00:23:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-94ce1d13-31d5-4218-9ce4-6f52b48e02cc tempest-TestImageHashVerification-401802276 None] Lock "cinder-8606ba7c-0955-4f0e-8d11-ceb115db13c8-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:58 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-69419605-f8e7-4e48-a21f-a27f660801ea tempest-VolumesActionsTest-1694507555 None] Terminate volume connection completed successfully. Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-69419605-f8e7-4e48-a21f-a27f660801ea tempest-VolumesActionsTest-1694507555 None] Acquiring lock "cinder-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb-detach_volume" by "detach_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-69419605-f8e7-4e48-a21f-a27f660801ea tempest-VolumesActionsTest-1694507555 None] Lock "cinder-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-69419605-f8e7-4e48-a21f-a27f660801ea tempest-VolumesActionsTest-1694507555 None] Detaching volume 2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb from instance ad6e38ca-b33d-4952-842c-86c1d4fa9a6d. Sep 23 00:23:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-69419605-f8e7-4e48-a21f-a27f660801ea tempest-VolumesActionsTest-1694507555 None] Detach volume completed successfully. Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-69419605-f8e7-4e48-a21f-a27f660801ea tempest-VolumesActionsTest-1694507555 None] Lock "cinder-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Acquiring lock "cinder-a8816449-cd9a-49c4-bf6d-7b94e55bb357-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c74631ee-d47b-4b53-b080-d7dd364b20e3 tempest-VolumesActionsTest-1046191595 None] Acquiring lock "cinder-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb-detach_volume" by "detach_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Lock "cinder-a8816449-cd9a-49c4-bf6d-7b94e55bb357-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c74631ee-d47b-4b53-b080-d7dd364b20e3 tempest-VolumesActionsTest-1046191595 None] Lock "cinder-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c74631ee-d47b-4b53-b080-d7dd364b20e3 tempest-VolumesActionsTest-1046191595 None] Volume detach called, but volume not attached. Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c74631ee-d47b-4b53-b080-d7dd364b20e3 tempest-VolumesActionsTest-1046191595 None] Lock "cinder-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Acquiring lock "cinder-quobyte-a8816449-cd9a-49c4-bf6d-7b94e55bb357" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Lock "cinder-quobyte-a8816449-cd9a-49c4-bf6d-7b94e55bb357" acquired by "delete_volume" :: waited 0.018s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a0b188-d9ec-4bc9-b2e1-5225ac3aecc6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:59 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357 Sep 23 00:23:59 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Acquiring lock "cinder-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Lock "cinder-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Acquiring lock "cinder-quobyte-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Lock "cinder-quobyte-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb" acquired by "delete_volume" :: waited 0.016s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e85e1e-6317-46b1-90b3-afc0f280c4e6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:59 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb Sep 23 00:23:59 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:00 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357" returned: 0 in 0.491s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:00 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357 Sep 23 00:24:00 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:00 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb" returned: 0 in 0.498s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:00 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb Sep 23 00:24:00 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:00 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a8816449-cd9a-49c4-bf6d-7b94e55bb357" returned: 0 in 0.399s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Lock "cinder-quobyte-a8816449-cd9a-49c4-bf6d-7b94e55bb357" released by "delete_volume" :: held 0.962s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Created reservations ['5f22b216-50dc-4729-a7a4-f6208ed131e5', '78965c3f-7564-4464-b535-2514f9b8e33e', '6b45826e-ec38-465d-968a-2cf1a272beb6', '8550cfc7-5295-472f-a0a2-a1f145c4ec70'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:00 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:00 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:00 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb" returned: 0 in 0.437s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Lock "cinder-quobyte-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb" released by "delete_volume" :: held 1.002s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:00 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Created reservations ['b92ff8ed-80bd-4d40-9638-56e0ddd5eeab', '7c43dc1a-74aa-4cfc-9756-983906317232', 'e7494772-1c89-4c6d-9cb5-33d11c45b272', 'd165ee5f-c435-452c-b331-ca5c77eee641'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:01 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:01 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:01 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.477s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:01 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:01 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Deleted volume successfully. Sep 23 00:24:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6d9e18fc-f0a1-4706-ad39-d5e62d139992 tempest-VolumesTransfersV357Test-528191422 None] Lock "cinder-a8816449-cd9a-49c4-bf6d-7b94e55bb357-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:01 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.324s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:01 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:01 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Deleted volume successfully. Sep 23 00:24:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-85e6ba75-2ecc-4d40-810d-a05a9c89f778 tempest-VolumesActionsTest-1046191595 None] Lock "cinder-2c8cdfe0-3ccd-4eb0-adf7-4f5811abd7fb-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-1170a2c7-b0e2-499c-aeff-697ca92e187a req-de6512e1-b77c-452e-b843-a6d042ae907e tempest-TestServerVolumeAttachmentScenario-271356783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-1170a2c7-b0e2-499c-aeff-697ca92e187a req-de6512e1-b77c-452e-b843-a6d042ae907e tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-1170a2c7-b0e2-499c-aeff-697ca92e187a req-de6512e1-b77c-452e-b843-a6d042ae907e tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-1170a2c7-b0e2-499c-aeff-697ca92e187a req-de6512e1-b77c-452e-b843-a6d042ae907e tempest-TestServerVolumeAttachmentScenario-271356783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-7f1263ec-3199-41b0-90e9-2798b9c02099', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b094c42-b552-48e9-8977-e96eb90ba146', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:24:06 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-1170a2c7-b0e2-499c-aeff-697ca92e187a req-de6512e1-b77c-452e-b843-a6d042ae907e tempest-TestServerVolumeAttachmentScenario-271356783 None] attachment_update completed successfully. Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Flow 'volume_create_manager' (90cc1ee8-01d1-44af-a40d-929a7fc9d360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6618bcf-1aa0-4830-a5ec-b5eaa1a4b708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6618bcf-1aa0-4830-a5ec-b5eaa1a4b708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030436270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd7d4481f343a2b5e3bb77fd219ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:08Z,use_quota=True,user_id='0c9bce053578439c9b30bfe2be0c7f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a13442-b547-48dc-aa5f-c16422aebdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a13442-b547-48dc-aa5f-c16422aebdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a777008-abd6-448c-89a0-11fffeb3d82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a777008-abd6-448c-89a0-11fffeb3d82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6', 'volume_name': 'volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8491aa87-571f-49a5-b0a4-3a9ce9f6e4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8491aa87-571f-49a5-b0a4-3a9ce9f6e4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4536f4b7-39c9-4ed0-b3ea-9c2dac5728bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:08 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Volume e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6', 'volume_size': 1} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030436270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd7d4481f343a2b5e3bb77fd219ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:08Z,use_quota=True,user_id='0c9bce053578439c9b30bfe2be0c7f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Creating volume e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:08 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:08 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6 1073741824 Sep 23 00:24:08 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:09 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-94981b36-f745-4d3a-9655-24dfc7269070 req-a2229c35-e625-46d0-b4af-ae5475d5e051 tempest-TestServerVolumeAttachmentScenario-271356783 None] Terminate volume connection completed successfully. Sep 23 00:24:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-94981b36-f745-4d3a-9655-24dfc7269070 req-a2229c35-e625-46d0-b4af-ae5475d5e051 tempest-TestServerVolumeAttachmentScenario-271356783 None] Deleting attachment 0b094c42-b552-48e9-8977-e96eb90ba146. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:24:09 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6 1073741824" returned: 0 in 0.934s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:09 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6 Sep 23 00:24:09 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:09 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6" returned: 0 in 0.382s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4536f4b7-39c9-4ed0-b3ea-9c2dac5728bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7aee8b-616b-4450-9180-b75d26f9b609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:09 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Volume volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6 (e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6): created successfully Sep 23 00:24:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7aee8b-616b-4450-9180-b75d26f9b609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Flow 'volume_create_manager' (90cc1ee8-01d1-44af-a40d-929a7fc9d360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:09 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-209be20d-55da-4c7f-9d00-bea31f07b0aa tempest-VolumesActionsTest-1046191595 None] Created volume successfully. Sep 23 00:24:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Acquiring lock "cinder-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Lock "cinder-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Acquiring lock "cinder-quobyte-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Lock "cinder-quobyte-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:10 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef7acb3-4897-48b9-8912-73e17fb53d70]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:10 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6 Sep 23 00:24:10 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:11 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6" returned: 0 in 0.611s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:11 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6 Sep 23 00:24:11 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-ca263893-0396-45f1-aabd-a192cdfe54dc req-144ab640-5805-4e17-beb9-3cc00684e6b1 tempest-TestServerVolumeAttachmentScenario-271356783 None] Terminate volume connection completed successfully. Sep 23 00:24:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-ca263893-0396-45f1-aabd-a192cdfe54dc req-144ab640-5805-4e17-beb9-3cc00684e6b1 tempest-TestServerVolumeAttachmentScenario-271356783 None] Deleting attachment 7ad896cd-0fc3-4739-a3a4-4e4b84fa286b. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:24:11 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:11 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6" returned: 0 in 0.382s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Lock "cinder-quobyte-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6" released by "delete_volume" :: held 1.080s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:12 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Created reservations ['417b8d7b-06b1-45e4-a3cd-e49f70900bd2', 'ad129b8b-3177-4ffd-a7f9-edae874a9262', '86f8d063-6543-43d3-97b8-602c6b56f9f2', '13f20fc2-bff3-48c4-beba-d81e134695c3'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:12 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:12 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:12 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.514s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:12 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:12 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Deleted volume successfully. Sep 23 00:24:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d9481cec-f087-4ec7-8df4-324d4a661dc3 tempest-VolumesActionsTest-1694507555 None] Lock "cinder-e23ce213-d9c8-4b66-88a4-3e1f2d08f1d6-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Flow 'volume_create_manager' (693bee41-2659-4b34-bd6e-842fedbac055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637e4642-a900-4a52-9a9e-2a4248ac4488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637e4642-a900-4a52-9a9e-2a4248ac4488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1759971690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8149d11-437a-472c-8828-c43720dc88e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd7d4481f343a2b5e3bb77fd219ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:14Z,use_quota=True,user_id='0c9bce053578439c9b30bfe2be0c7f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca93084-83b8-486b-b403-b06c744aeed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca93084-83b8-486b-b403-b06c744aeed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a712a8-c1bc-450e-9531-b4159b0f399a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a712a8-c1bc-450e-9531-b4159b0f399a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8149d11-437a-472c-8828-c43720dc88e8', 'volume_name': 'volume-c8149d11-437a-472c-8828-c43720dc88e8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc2388c-1443-4f9b-8a0d-48fd15dcea8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc2388c-1443-4f9b-8a0d-48fd15dcea8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99799cf-ce2d-48d2-86eb-7a23eaa3bf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:14 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Volume c8149d11-437a-472c-8828-c43720dc88e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8149d11-437a-472c-8828-c43720dc88e8', 'volume_size': 1} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1759971690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8149d11-437a-472c-8828-c43720dc88e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd7d4481f343a2b5e3bb77fd219ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:14Z,use_quota=True,user_id='0c9bce053578439c9b30bfe2be0c7f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Creating volume c8149d11-437a-472c-8828-c43720dc88e8 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:14 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8149d11-437a-472c-8828-c43720dc88e8 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:14 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8149d11-437a-472c-8828-c43720dc88e8 1073741824 Sep 23 00:24:14 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Flow 'volume_create_manager' (21ade9d8-fe08-4035-9e7f-71a48fc74bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21ba15f-8046-4db3-8db2-e4e5ecf7884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21ba15f-8046-4db3-8db2-e4e5ecf7884b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-787910781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf146edb-72cb-439c-8995-26dce4366583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287b4295acc448b7ab56ed0570d1ac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:15Z,use_quota=True,user_id='3675dd4b4c494f5d80b8c94d5b4eac57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bf84c8-0978-4b45-ab2e-6004ca651720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bf84c8-0978-4b45-ab2e-6004ca651720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71929054-0b76-44e3-b204-2af5d2938a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71929054-0b76-44e3-b204-2af5d2938a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf146edb-72cb-439c-8995-26dce4366583', 'volume_name': 'volume-bf146edb-72cb-439c-8995-26dce4366583', 'volume_size': 2}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f8dd33-32a3-4eb7-9cd9-d77d9f134c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f8dd33-32a3-4eb7-9cd9-d77d9f134c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602d2e48-98b2-4f46-81bf-6a6ba5d9a3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:15 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Volume bf146edb-72cb-439c-8995-26dce4366583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf146edb-72cb-439c-8995-26dce4366583', 'volume_size': 2} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:15 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8149d11-437a-472c-8828-c43720dc88e8 1073741824" returned: 0 in 0.850s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8149d11-437a-472c-8828-c43720dc88e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:15 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8149d11-437a-472c-8828-c43720dc88e8 Sep 23 00:24:15 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:15 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8149d11-437a-472c-8828-c43720dc88e8" returned: 0 in 0.284s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-787910781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf146edb-72cb-439c-8995-26dce4366583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287b4295acc448b7ab56ed0570d1ac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:15Z,use_quota=True,user_id='3675dd4b4c494f5d80b8c94d5b4eac57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Creating volume bf146edb-72cb-439c-8995-26dce4366583 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:15 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf146edb-72cb-439c-8995-26dce4366583 2147483648 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99799cf-ce2d-48d2-86eb-7a23eaa3bf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8149d11-437a-472c-8828-c43720dc88e8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:15 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf146edb-72cb-439c-8995-26dce4366583 2147483648 Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548420af-0bfe-4154-aa5b-dd6ad42793e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:15 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:15 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Volume volume-c8149d11-437a-472c-8828-c43720dc88e8 (c8149d11-437a-472c-8828-c43720dc88e8): created successfully Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548420af-0bfe-4154-aa5b-dd6ad42793e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Flow 'volume_create_manager' (693bee41-2659-4b34-bd6e-842fedbac055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:15 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0ebe3b5e-250b-4516-bdd9-178c177790ac tempest-VolumesActionsTest-1046191595 None] Created volume successfully. Sep 23 00:24:16 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf146edb-72cb-439c-8995-26dce4366583 2147483648" returned: 0 in 0.868s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Acquiring lock "cinder-c8149d11-437a-472c-8828-c43720dc88e8-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Lock "cinder-c8149d11-437a-472c-8828-c43720dc88e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf146edb-72cb-439c-8995-26dce4366583 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:16 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf146edb-72cb-439c-8995-26dce4366583 Sep 23 00:24:16 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Acquiring lock "cinder-quobyte-c8149d11-437a-472c-8828-c43720dc88e8" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Lock "cinder-quobyte-c8149d11-437a-472c-8828-c43720dc88e8" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:16 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1f6e5c-98fe-4c41-b2cd-57a01606ba83]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8149d11-437a-472c-8828-c43720dc88e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:17 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8149d11-437a-472c-8828-c43720dc88e8 Sep 23 00:24:17 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:17 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf146edb-72cb-439c-8995-26dce4366583" returned: 0 in 0.440s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (602d2e48-98b2-4f46-81bf-6a6ba5d9a3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf146edb-72cb-439c-8995-26dce4366583', 'volume_size': 2}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aeed914-1a5a-4ad3-8f88-06a4f3040512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:17 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Volume volume-bf146edb-72cb-439c-8995-26dce4366583 (bf146edb-72cb-439c-8995-26dce4366583): created successfully Sep 23 00:24:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aeed914-1a5a-4ad3-8f88-06a4f3040512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Flow 'volume_create_manager' (21ade9d8-fe08-4035-9e7f-71a48fc74bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3838f73b-6970-435d-98d7-283071a743c2 tempest-VolumesCloneNegativeTest-1894411764 None] Created volume successfully. Sep 23 00:24:17 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8149d11-437a-472c-8828-c43720dc88e8" returned: 0 in 0.585s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8149d11-437a-472c-8828-c43720dc88e8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:17 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8149d11-437a-472c-8828-c43720dc88e8 Sep 23 00:24:17 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:17 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c8149d11-437a-472c-8828-c43720dc88e8" returned: 0 in 0.324s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Lock "cinder-quobyte-c8149d11-437a-472c-8828-c43720dc88e8" released by "delete_volume" :: held 0.972s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:17 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Created reservations ['a30ed5aa-d619-4e43-b742-f5867d56206a', '49285fa1-1466-4759-9807-78b13c974ea6', 'bfe1a9ab-9526-4108-b786-df9e3df9519a', '834c4443-59bf-4924-96ef-d8e870064afb'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:18 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:18 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:18 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.368s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:18 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Deleted volume successfully. Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5120b335-943c-4a6a-a17b-bfbd7ddb448d tempest-VolumesActionsTest-1694507555 None] Lock "cinder-c8149d11-437a-472c-8828-c43720dc88e8-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Acquiring lock "cinder-bf146edb-72cb-439c-8995-26dce4366583-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Lock "cinder-bf146edb-72cb-439c-8995-26dce4366583-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Acquiring lock "cinder-quobyte-bf146edb-72cb-439c-8995-26dce4366583" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Lock "cinder-quobyte-bf146edb-72cb-439c-8995-26dce4366583" acquired by "delete_volume" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[81694a67-1757-4211-9f1a-76f890fd0c0d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf146edb-72cb-439c-8995-26dce4366583 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:18 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf146edb-72cb-439c-8995-26dce4366583 Sep 23 00:24:18 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:19 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf146edb-72cb-439c-8995-26dce4366583" returned: 0 in 0.565s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf146edb-72cb-439c-8995-26dce4366583 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:19 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf146edb-72cb-439c-8995-26dce4366583 Sep 23 00:24:19 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Acquiring lock "cinder-7f1263ec-3199-41b0-90e9-2798b9c02099-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "cinder-7f1263ec-3199-41b0-90e9-2798b9c02099-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Acquiring lock "cinder-quobyte-7f1263ec-3199-41b0-90e9-2798b9c02099" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:19 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf146edb-72cb-439c-8995-26dce4366583" returned: 0 in 0.526s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "cinder-quobyte-7f1263ec-3199-41b0-90e9-2798b9c02099" acquired by "delete_volume" :: waited 0.040s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Lock "cinder-quobyte-bf146edb-72cb-439c-8995-26dce4366583" released by "delete_volume" :: held 1.193s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8599725d-7d07-4581-9282-8a98faa453d0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f1263ec-3199-41b0-90e9-2798b9c02099 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Flow 'volume_create_manager' (7f83e938-7b49-4530-b814-7194b8c0573e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:20 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f1263ec-3199-41b0-90e9-2798b9c02099 Sep 23 00:24:20 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a03e8ab-bb18-4c03-81a2-c063288f11ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Created reservations ['7488e93a-0888-4cfb-884a-83e8268ede81', '5829e29a-7260-4937-bf38-02cfd81d9632', '3c27ea05-bb81-435f-b363-72e47b283c64', '23494bc1-aa36-45e2-9d2c-44a56520cbf5'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a03e8ab-bb18-4c03-81a2-c063288f11ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1784037347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fbce332-c172-4d64-a57e-dd93bde6a41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd7d4481f343a2b5e3bb77fd219ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:20Z,use_quota=True,user_id='0c9bce053578439c9b30bfe2be0c7f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2ce930-0f14-4cbf-93e1-b4ac21bf8057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2ce930-0f14-4cbf-93e1-b4ac21bf8057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d49babf-dd9e-4ee8-b8e0-ae271c61790a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d49babf-dd9e-4ee8-b8e0-ae271c61790a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fbce332-c172-4d64-a57e-dd93bde6a41e', 'volume_name': 'volume-9fbce332-c172-4d64-a57e-dd93bde6a41e', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d09fdf-5922-469b-8ade-834c6d30e13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d09fdf-5922-469b-8ade-834c6d30e13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ef4ec1-1361-4f7d-afd1-dcf1256716b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:20 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Volume 9fbce332-c172-4d64-a57e-dd93bde6a41e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fbce332-c172-4d64-a57e-dd93bde6a41e', 'volume_size': 1} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1784037347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fbce332-c172-4d64-a57e-dd93bde6a41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd7d4481f343a2b5e3bb77fd219ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:20Z,use_quota=True,user_id='0c9bce053578439c9b30bfe2be0c7f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Creating volume 9fbce332-c172-4d64-a57e-dd93bde6a41e {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:20 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fbce332-c172-4d64-a57e-dd93bde6a41e 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:20 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fbce332-c172-4d64-a57e-dd93bde6a41e 1073741824 Sep 23 00:24:20 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:20 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:20 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:20 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f1263ec-3199-41b0-90e9-2798b9c02099" returned: 0 in 0.571s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f1263ec-3199-41b0-90e9-2798b9c02099 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:20 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f1263ec-3199-41b0-90e9-2798b9c02099 Sep 23 00:24:20 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:20 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.424s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Deleted volume successfully. Sep 23 00:24:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a85b8200-2db3-4ef8-b56d-410d23dbd77d tempest-VolumesCloneNegativeTest-1894411764 None] Lock "cinder-bf146edb-72cb-439c-8995-26dce4366583-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:21 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fbce332-c172-4d64-a57e-dd93bde6a41e 1073741824" returned: 0 in 0.777s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fbce332-c172-4d64-a57e-dd93bde6a41e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:21 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fbce332-c172-4d64-a57e-dd93bde6a41e Sep 23 00:24:21 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:21 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f1263ec-3199-41b0-90e9-2798b9c02099" returned: 0 in 0.537s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "cinder-quobyte-7f1263ec-3199-41b0-90e9-2798b9c02099" released by "delete_volume" :: held 1.197s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Created reservations ['bd3de7f3-74f3-44c7-8cba-3b07ff9f5e15', '6db81323-0304-483f-a9eb-195e8f5b7178', 'dd7653c4-1c74-4fec-bef7-a6c91bc6cbfd', '41a84f4b-dc0f-4430-8051-71a5365d310f'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:21 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:21 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:21 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fbce332-c172-4d64-a57e-dd93bde6a41e" returned: 0 in 0.388s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ef4ec1-1361-4f7d-afd1-dcf1256716b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fbce332-c172-4d64-a57e-dd93bde6a41e', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d6e184-6e77-4c70-94e7-5d87a9dd1a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:21 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Volume volume-9fbce332-c172-4d64-a57e-dd93bde6a41e (9fbce332-c172-4d64-a57e-dd93bde6a41e): created successfully Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d6e184-6e77-4c70-94e7-5d87a9dd1a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Flow 'volume_create_manager' (7f83e938-7b49-4530-b814-7194b8c0573e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:21 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4295f64c-e756-45f4-b799-b222dc8e94bb tempest-VolumesActionsTest-1046191595 None] Created volume successfully. Sep 23 00:24:21 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.360s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:21 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Deleted volume successfully. Sep 23 00:24:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e84756f8-fa21-47ce-a893-4ba6cd84077b tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "cinder-7f1263ec-3199-41b0-90e9-2798b9c02099-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Acquiring lock "cinder-d92cbe93-74a6-413d-b359-c7800c3875c3-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "cinder-d92cbe93-74a6-413d-b359-c7800c3875c3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Acquiring lock "cinder-quobyte-d92cbe93-74a6-413d-b359-c7800c3875c3" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "cinder-quobyte-d92cbe93-74a6-413d-b359-c7800c3875c3" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[36855dd3-0177-49d1-87cc-1edb5950bedb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d92cbe93-74a6-413d-b359-c7800c3875c3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Acquiring lock "cinder-9fbce332-c172-4d64-a57e-dd93bde6a41e-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Lock "cinder-9fbce332-c172-4d64-a57e-dd93bde6a41e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Acquiring lock "cinder-quobyte-9fbce332-c172-4d64-a57e-dd93bde6a41e" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Lock "cinder-quobyte-9fbce332-c172-4d64-a57e-dd93bde6a41e" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:22 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d92cbe93-74a6-413d-b359-c7800c3875c3 Sep 23 00:24:22 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf48cc7-1464-48e4-819d-35cf3cb23ece]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fbce332-c172-4d64-a57e-dd93bde6a41e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:22 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fbce332-c172-4d64-a57e-dd93bde6a41e Sep 23 00:24:22 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:22 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d92cbe93-74a6-413d-b359-c7800c3875c3" returned: 0 in 0.580s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d92cbe93-74a6-413d-b359-c7800c3875c3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:23 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d92cbe93-74a6-413d-b359-c7800c3875c3 Sep 23 00:24:23 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:23 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fbce332-c172-4d64-a57e-dd93bde6a41e" returned: 0 in 0.583s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fbce332-c172-4d64-a57e-dd93bde6a41e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:23 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fbce332-c172-4d64-a57e-dd93bde6a41e Sep 23 00:24:23 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:23 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d92cbe93-74a6-413d-b359-c7800c3875c3" returned: 0 in 0.391s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "cinder-quobyte-d92cbe93-74a6-413d-b359-c7800c3875c3" released by "delete_volume" :: held 1.065s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Created reservations ['29cd72c8-5291-4baf-b826-505bff5442af', 'bfc67d72-ae9c-48a9-a7ef-9b4c3001af36', 'c823cd11-a106-4afb-a897-dee0da7cae64', '566cc4be-2a6c-49da-b146-6fa70c46530d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:23 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fbce332-c172-4d64-a57e-dd93bde6a41e" returned: 0 in 0.457s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Lock "cinder-quobyte-9fbce332-c172-4d64-a57e-dd93bde6a41e" released by "delete_volume" :: held 1.111s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:23 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:23 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Created reservations ['92b6b749-2231-4920-b5f2-d9004288e1bd', '2c1c4b55-35a3-4657-8713-5cbf69312f95', '0fccd8c4-7b25-4e64-9a60-7963868cd7b4', '8bac3648-67ad-47c1-ac4d-0c846ee32aed'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:24 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:24 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Flow 'volume_create_manager' (580e6399-8c05-499c-a2ce-028a08fc7f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae854d4-e5f6-4ee7-94fb-f3a7e5ded35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae854d4-e5f6-4ee7-94fb-f3a7e5ded35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1111999766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594e7d56-027d-471d-9b6d-a1cf2e88f171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f651ccfaa424916b0d8c3c8933a942a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:24Z,use_quota=True,user_id='95ac6d56a1224d25831c3dbc7c7dc47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e7fbb5-cb05-426b-9634-708bae924ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e7fbb5-cb05-426b-9634-708bae924ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f56ee2-7ea8-4b90-a4f1-776149d36948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f56ee2-7ea8-4b90-a4f1-776149d36948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '594e7d56-027d-471d-9b6d-a1cf2e88f171', 'volume_name': 'volume-594e7d56-027d-471d-9b6d-a1cf2e88f171', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a641aa-89d9-4ca9-aa08-9bd08491fe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a641aa-89d9-4ca9-aa08-9bd08491fe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d93dbbc-3a0f-4b8f-991f-0f8b06693c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:24 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Volume 594e7d56-027d-471d-9b6d-a1cf2e88f171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-594e7d56-027d-471d-9b6d-a1cf2e88f171', 'volume_size': 1} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1111999766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594e7d56-027d-471d-9b6d-a1cf2e88f171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f651ccfaa424916b0d8c3c8933a942a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:24Z,use_quota=True,user_id='95ac6d56a1224d25831c3dbc7c7dc47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Creating volume 594e7d56-027d-471d-9b6d-a1cf2e88f171 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:24 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-594e7d56-027d-471d-9b6d-a1cf2e88f171 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:24 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-594e7d56-027d-471d-9b6d-a1cf2e88f171 1073741824 Sep 23 00:24:24 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:24 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.422s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:24 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Deleted volume successfully. Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f040a52-fb31-4694-9ae2-9f277c08aed2 tempest-TestServerVolumeAttachmentScenario-271356783 None] Lock "cinder-d92cbe93-74a6-413d-b359-c7800c3875c3-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:24 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.531s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:24 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Deleted volume successfully. Sep 23 00:24:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cfb5094a-a684-458f-bb4a-9bceb55dd682 tempest-VolumesActionsTest-1694507555 None] Lock "cinder-9fbce332-c172-4d64-a57e-dd93bde6a41e-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:24 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-594e7d56-027d-471d-9b6d-a1cf2e88f171 1073741824" returned: 0 in 0.827s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Flow 'volume_create_manager' (072f0d74-a663-4b83-9033-1f3a21bbeab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b255117-203d-40e3-a37d-922ec4fa553c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-594e7d56-027d-471d-9b6d-a1cf2e88f171 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:25 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-594e7d56-027d-471d-9b6d-a1cf2e88f171 Sep 23 00:24:25 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b255117-203d-40e3-a37d-922ec4fa553c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527696215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789b7c35-f26a-451a-955a-f404c2aec27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f651ccfaa424916b0d8c3c8933a942a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:25Z,use_quota=True,user_id='95ac6d56a1224d25831c3dbc7c7dc47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d89d546-96d0-4e61-a5c9-24260bcff99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d89d546-96d0-4e61-a5c9-24260bcff99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef13b911-3845-4a90-9d35-d2cfd061e892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef13b911-3845-4a90-9d35-d2cfd061e892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '789b7c35-f26a-451a-955a-f404c2aec27b', 'volume_name': 'volume-789b7c35-f26a-451a-955a-f404c2aec27b', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91a25d3-47ff-4ba0-9068-7d8d0027ba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91a25d3-47ff-4ba0-9068-7d8d0027ba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f14a22-7ccf-4467-acd7-d06adfc1b20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:25 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Volume 789b7c35-f26a-451a-955a-f404c2aec27b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-789b7c35-f26a-451a-955a-f404c2aec27b', 'volume_size': 1} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:25 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-594e7d56-027d-471d-9b6d-a1cf2e88f171" returned: 0 in 0.462s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527696215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789b7c35-f26a-451a-955a-f404c2aec27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f651ccfaa424916b0d8c3c8933a942a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:25Z,use_quota=True,user_id='95ac6d56a1224d25831c3dbc7c7dc47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Creating volume 789b7c35-f26a-451a-955a-f404c2aec27b {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:25 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-789b7c35-f26a-451a-955a-f404c2aec27b 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:25 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-789b7c35-f26a-451a-955a-f404c2aec27b 1073741824 Sep 23 00:24:25 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d93dbbc-3a0f-4b8f-991f-0f8b06693c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-594e7d56-027d-471d-9b6d-a1cf2e88f171', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24700882-5224-4095-bb59-771bc4863e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Flow 'volume_create_manager' (7e5eb7be-d562-4470-9a71-0ca5b18cb534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ddc727-cf06-4f4b-9bb1-e6a432c1a9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:25 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Volume volume-594e7d56-027d-471d-9b6d-a1cf2e88f171 (594e7d56-027d-471d-9b6d-a1cf2e88f171): created successfully Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24700882-5224-4095-bb59-771bc4863e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Flow 'volume_create_manager' (580e6399-8c05-499c-a2ce-028a08fc7f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ddc727-cf06-4f4b-9bb1-e6a432c1a9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1021664275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf498226-e6eb-4a0d-9e72-efd6eecbbd95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f651ccfaa424916b0d8c3c8933a942a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:26Z,use_quota=True,user_id='95ac6d56a1224d25831c3dbc7c7dc47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b204abf-9e62-44e1-b97d-03e4a7cf48b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b204abf-9e62-44e1-b97d-03e4a7cf48b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b21cb9-2f6c-45a8-b3a4-5c9210d096e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b21cb9-2f6c-45a8-b3a4-5c9210d096e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf498226-e6eb-4a0d-9e72-efd6eecbbd95', 'volume_name': 'volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8c1b6c-d024-439d-8257-da70c27d7693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8c1b6c-d024-439d-8257-da70c27d7693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58dcb111-c5f7-40ca-9fd5-5f6ca87e1c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Volume bf498226-e6eb-4a0d-9e72-efd6eecbbd95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95', 'volume_size': 1} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:26 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b5e64aff-fd9a-464a-b6aa-ff29815099f7 tempest-CreateVolumesFromImageTest-820323737 None] Created volume successfully. Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Flow 'volume_create_manager' (cc438226-7b17-4915-b2b3-231e7fb6a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b211f0c5-822a-4737-a666-acffdfa9d7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b211f0c5-822a-4737-a666-acffdfa9d7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1598275201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0949d670-e056-4ccc-a0d0-811c1e37f41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd7d4481f343a2b5e3bb77fd219ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:26Z,use_quota=True,user_id='0c9bce053578439c9b30bfe2be0c7f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7067145d-6d92-47f0-87b3-eb4207d5d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7067145d-6d92-47f0-87b3-eb4207d5d287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a69f60-467c-4f13-80f8-b50cb4aa1284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a69f60-467c-4f13-80f8-b50cb4aa1284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0949d670-e056-4ccc-a0d0-811c1e37f41a', 'volume_name': 'volume-0949d670-e056-4ccc-a0d0-811c1e37f41a', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c46921-5285-4b2c-81bb-59815bc9e860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c46921-5285-4b2c-81bb-59815bc9e860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f819265-96c5-46ef-b9e2-0bd3800039ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Volume 0949d670-e056-4ccc-a0d0-811c1e37f41a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0949d670-e056-4ccc-a0d0-811c1e37f41a', 'volume_size': 1} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-789b7c35-f26a-451a-955a-f404c2aec27b 1073741824" returned: 0 in 0.903s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-789b7c35-f26a-451a-955a-f404c2aec27b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:26 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-789b7c35-f26a-451a-955a-f404c2aec27b Sep 23 00:24:26 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Flow 'volume_create_manager' (5ffe1545-5657-45a1-805a-70a6148c3a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c45560a-020f-4fe7-97c7-0e75e36cf8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c45560a-020f-4fe7-97c7-0e75e36cf8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-431718579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f4b4f30-0ef3-4735-95e6-74369b4dd219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f651ccfaa424916b0d8c3c8933a942a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:27Z,use_quota=True,user_id='95ac6d56a1224d25831c3dbc7c7dc47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd484f6-dbf6-4065-bce5-a083d4647279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd484f6-dbf6-4065-bce5-a083d4647279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646a9616-6999-42e0-8e3d-2b757fbd53da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646a9616-6999-42e0-8e3d-2b757fbd53da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f4b4f30-0ef3-4735-95e6-74369b4dd219', 'volume_name': 'volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e31627-3178-4202-a273-71b21a8fa4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e31627-3178-4202-a273-71b21a8fa4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbe5934-0807-4978-9ae2-537132885b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Volume 0f4b4f30-0ef3-4735-95e6-74369b4dd219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219', 'volume_size': 1} Sep 23 00:24:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:27 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-789b7c35-f26a-451a-955a-f404c2aec27b" returned: 0 in 0.429s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.054s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1021664275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf498226-e6eb-4a0d-9e72-efd6eecbbd95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f651ccfaa424916b0d8c3c8933a942a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:26Z,use_quota=True,user_id='95ac6d56a1224d25831c3dbc7c7dc47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Creating volume bf498226-e6eb-4a0d-9e72-efd6eecbbd95 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:27 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f14a22-7ccf-4467-acd7-d06adfc1b20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789b7c35-f26a-451a-955a-f404c2aec27b', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728dac5c-59ff-48ab-9bf0-c7efad90fdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:27 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95 1073741824 Sep 23 00:24:27 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:27 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Volume volume-789b7c35-f26a-451a-955a-f404c2aec27b (789b7c35-f26a-451a-955a-f404c2aec27b): created successfully Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728dac5c-59ff-48ab-9bf0-c7efad90fdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Flow 'volume_create_manager' (072f0d74-a663-4b83-9033-1f3a21bbeab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Flow 'volume_create_manager' (4935e5a8-fc76-4441-ad0d-8e47d0ce1f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554caab8-c21d-4f11-8b7e-8599dcba38da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:27 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c53a95cc-85c8-432b-bdb8-7b57aa6b75bf tempest-CreateVolumesFromImageTest-820323737 None] Created volume successfully. Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554caab8-c21d-4f11-8b7e-8599dcba38da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1423173828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4581e185-c9c3-4d91-a603-a663039c47b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f651ccfaa424916b0d8c3c8933a942a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:27Z,use_quota=True,user_id='95ac6d56a1224d25831c3dbc7c7dc47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba26fc2-4cbd-48c0-987d-f70bf596a7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba26fc2-4cbd-48c0-987d-f70bf596a7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef30ba62-7a3a-4eec-920e-2757945911f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef30ba62-7a3a-4eec-920e-2757945911f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4581e185-c9c3-4d91-a603-a663039c47b2', 'volume_name': 'volume-4581e185-c9c3-4d91-a603-a663039c47b2', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0219af8c-6689-4cfa-a087-906fbba784b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0219af8c-6689-4cfa-a087-906fbba784b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053b958d-40d5-470a-8433-ba8129ee3a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:27 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Volume 4581e185-c9c3-4d91-a603-a663039c47b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4581e185-c9c3-4d91-a603-a663039c47b2', 'volume_size': 1} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:27 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95 1073741824" returned: 0 in 0.622s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:27 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95 Sep 23 00:24:27 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:28 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95" returned: 0 in 0.348s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.596s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1598275201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0949d670-e056-4ccc-a0d0-811c1e37f41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd7d4481f343a2b5e3bb77fd219ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:26Z,use_quota=True,user_id='0c9bce053578439c9b30bfe2be0c7f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Creating volume 0949d670-e056-4ccc-a0d0-811c1e37f41a {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:28 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0949d670-e056-4ccc-a0d0-811c1e37f41a 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:28 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0949d670-e056-4ccc-a0d0-811c1e37f41a 1073741824 Sep 23 00:24:28 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58dcb111-c5f7-40ca-9fd5-5f6ca87e1c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da525288-399a-4f0f-84e8-26bee7117a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:28 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Volume volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95 (bf498226-e6eb-4a0d-9e72-efd6eecbbd95): created successfully Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da525288-399a-4f0f-84e8-26bee7117a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Flow 'volume_create_manager' (7e5eb7be-d562-4470-9a71-0ca5b18cb534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:28 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d25ca752-c292-4f27-aebc-40f9d76145fc tempest-CreateVolumesFromImageTest-820323737 None] Created volume successfully. Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:28 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Flow 'volume_create_manager' (2dde65c7-20f0-48af-97cb-a5e786e759a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975a440a-78b8-4f7a-abe6-862cf1e9280c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0949d670-e056-4ccc-a0d0-811c1e37f41a 1073741824" returned: 0 in 0.640s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975a440a-78b8-4f7a-abe6-862cf1e9280c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1507758415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2077193f-ffc7-4639-98aa-456119326864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a07a8fa1458d938fc55cc68b25a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:29Z,use_quota=True,user_id='6ad7847ddb474a1e86a6c3ae5c7714ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3162be-ee1a-4a76-83e5-d2b15d763aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3162be-ee1a-4a76-83e5-d2b15d763aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7133da2-bce1-4d10-9153-3975cf3bbd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG cinder.image.glance [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Creating Keystone auth plugin from conf {{(pid=86481) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:24:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0949d670-e056-4ccc-a0d0-811c1e37f41a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:28 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0949d670-e056-4ccc-a0d0-811c1e37f41a Sep 23 00:24:28 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7133da2-bce1-4d10-9153-3975cf3bbd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2077193f-ffc7-4639-98aa-456119326864', 'volume_name': 'volume-2077193f-ffc7-4639-98aa-456119326864', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec0b088-0019-447b-98cc-5e4f8f4d9591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec0b088-0019-447b-98cc-5e4f8f4d9591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec22da99-d816-45d7-b7ca-ca4c90edb60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:29 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Volume 2077193f-ffc7-4639-98aa-456119326864: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2077193f-ffc7-4639-98aa-456119326864', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Trying to clone 2077193f-ffc7-4639-98aa-456119326864 from image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]). {{(pid=86481) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:24:29 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0949d670-e056-4ccc-a0d0-811c1e37f41a" returned: 0 in 0.365s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.414s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-431718579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f4b4f30-0ef3-4735-95e6-74369b4dd219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f651ccfaa424916b0d8c3c8933a942a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:27Z,use_quota=True,user_id='95ac6d56a1224d25831c3dbc7c7dc47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Creating volume 0f4b4f30-0ef3-4735-95e6-74369b4dd219 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:29 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:29 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219 1073741824 Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f819265-96c5-46ef-b9e2-0bd3800039ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0949d670-e056-4ccc-a0d0-811c1e37f41a', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:29 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d471c8b5-7ff5-49ab-8485-6b29493c3213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:29 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Volume volume-0949d670-e056-4ccc-a0d0-811c1e37f41a (0949d670-e056-4ccc-a0d0-811c1e37f41a): created successfully Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d471c8b5-7ff5-49ab-8485-6b29493c3213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Flow 'volume_create_manager' (cc438226-7b17-4915-b2b3-231e7fb6a034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:29 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9731bd56-1e69-468e-b295-442590f59fdf tempest-VolumesActionsTest-1046191595 None] Created volume successfully. Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:24:29 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fbf8c6-1b1d-44c6-95fd-122dcade8ec9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:29 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219 1073741824" returned: 0 in 0.620s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:29 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219 Sep 23 00:24:29 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:29 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD Sep 23 00:24:29 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:30 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD" returned: 0 in 0.507s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Temporary image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 is fetched for user 6ad7847ddb474a1e86a6c3ae5c7714ff. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:24:30 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219" returned: 0 in 0.428s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.052s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1423173828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4581e185-c9c3-4d91-a603-a663039c47b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f651ccfaa424916b0d8c3c8933a942a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:27Z,use_quota=True,user_id='95ac6d56a1224d25831c3dbc7c7dc47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Creating volume 4581e185-c9c3-4d91-a603-a663039c47b2 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:30 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4581e185-c9c3-4d91-a603-a663039c47b2 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Acquiring lock "cinder-0949d670-e056-4ccc-a0d0-811c1e37f41a-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:30 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4581e185-c9c3-4d91-a603-a663039c47b2 1073741824 Sep 23 00:24:30 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbe5934-0807-4978-9ae2-537132885b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f17fd95-91da-4fc8-bcb8-101e652cbd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Lock "cinder-0949d670-e056-4ccc-a0d0-811c1e37f41a-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:30 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Volume volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219 (0f4b4f30-0ef3-4735-95e6-74369b4dd219): created successfully Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f17fd95-91da-4fc8-bcb8-101e652cbd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Flow 'volume_create_manager' (5ffe1545-5657-45a1-805a-70a6148c3a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:30 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7b77e243-2b21-4ace-b523-284b6216002d tempest-CreateVolumesFromImageTest-820323737 None] Created volume successfully. Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1543d6-be4d-4744-b1cd-4b91c6d25ea4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Acquiring lock "cinder-quobyte-0949d670-e056-4ccc-a0d0-811c1e37f41a" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Lock "cinder-quobyte-0949d670-e056-4ccc-a0d0-811c1e37f41a" acquired by "delete_volume" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90284f3-8466-48be-9633-68d9a21f0b72]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:30 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD Sep 23 00:24:30 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0949d670-e056-4ccc-a0d0-811c1e37f41a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:31 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0949d670-e056-4ccc-a0d0-811c1e37f41a Sep 23 00:24:31 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:31 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:31 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4581e185-c9c3-4d91-a603-a663039c47b2 1073741824" returned: 0 in 0.931s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4581e185-c9c3-4d91-a603-a663039c47b2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:31 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4581e185-c9c3-4d91-a603-a663039c47b2 Sep 23 00:24:31 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:31 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0949d670-e056-4ccc-a0d0-811c1e37f41a" returned: 0 in 0.601s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0949d670-e056-4ccc-a0d0-811c1e37f41a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:31 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0949d670-e056-4ccc-a0d0-811c1e37f41a Sep 23 00:24:31 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:31 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4581e185-c9c3-4d91-a603-a663039c47b2" returned: 0 in 0.415s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1507758415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2077193f-ffc7-4639-98aa-456119326864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a07a8fa1458d938fc55cc68b25a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:29Z,use_quota=True,user_id='6ad7847ddb474a1e86a6c3ae5c7714ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Creating volume 2077193f-ffc7-4639-98aa-456119326864 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:31 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:31 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 1073741824 Sep 23 00:24:31 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053b958d-40d5-470a-8433-ba8129ee3a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4581e185-c9c3-4d91-a603-a663039c47b2', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7ca353-c837-4f6a-b68d-deb5e2ff80d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:31 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Volume volume-4581e185-c9c3-4d91-a603-a663039c47b2 (4581e185-c9c3-4d91-a603-a663039c47b2): created successfully Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7ca353-c837-4f6a-b68d-deb5e2ff80d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:31 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Flow 'volume_create_manager' (4935e5a8-fc76-4441-ad0d-8e47d0ce1f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0949d670-e056-4ccc-a0d0-811c1e37f41a" returned: 0 in 0.452s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:31 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Lock "cinder-quobyte-0949d670-e056-4ccc-a0d0-811c1e37f41a" released by "delete_volume" :: held 1.134s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:31 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f04a2f91-1d1b-45f0-884c-abce44d9063c tempest-CreateVolumesFromImageTest-820323737 None] Created volume successfully. Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Created reservations ['0f40e8ab-37f5-4035-b7c4-05acd0bb1f45', '859eaaa7-3cf3-4527-9d68-d89bb44a29de', 'a38b003e-8b11-42e8-b22a-0dd06125f25f', '72cbb002-32d5-45c4-b810-56c70b3f1d57'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:32 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:32 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:32 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.346s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:32 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:32 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Deleted volume successfully. Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 1073741824" returned: 0 in 0.693s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1437297-daad-4271-875c-f8231afe6127 tempest-VolumesActionsTest-1694507555 None] Lock "cinder-0949d670-e056-4ccc-a0d0-811c1e37f41a-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:32 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 Sep 23 00:24:32 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "cinder-4581e185-c9c3-4d91-a603-a663039c47b2-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-4581e185-c9c3-4d91-a603-a663039c47b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:32 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864" returned: 0 in 0.400s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "cinder-quobyte-4581e185-c9c3-4d91-a603-a663039c47b2" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Attempting download of 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}])) to volume 2077193f-ffc7-4639-98aa-456119326864. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-quobyte-4581e185-c9c3-4d91-a603-a663039c47b2" acquired by "delete_volume" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2af9cc-6b7f-432e-954e-9046fed12f97]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4581e185-c9c3-4d91-a603-a663039c47b2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6727626-e25a-47da-bbd3-efb033bc5aa3]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wbn_avp0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:33 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wbn_avp0 Sep 23 00:24:33 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:33 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4581e185-c9c3-4d91-a603-a663039c47b2 Sep 23 00:24:33 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Flow 'volume_create_manager' (3a404607-5631-4b8a-8862-149a3afb9c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:33 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5446fd3e-0aee-44a4-a3e4-844ba423118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wbn_avp0" returned: 0 in 0.579s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wbn_avp0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5446fd3e-0aee-44a4-a3e4-844ba423118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-352082424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3590b7-0504-4f8f-a115-f8c1d0700755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd7d4481f343a2b5e3bb77fd219ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:34Z,use_quota=True,user_id='0c9bce053578439c9b30bfe2be0c7f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89a51f3-0d10-4fe7-86c4-6d6d668a0062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89a51f3-0d10-4fe7-86c4-6d6d668a0062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:33 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d294eb-ac78-47dc-a74d-b8f0e6ea16ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d294eb-ac78-47dc-a74d-b8f0e6ea16ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3590b7-0504-4f8f-a115-f8c1d0700755', 'volume_name': 'volume-6e3590b7-0504-4f8f-a115-f8c1d0700755', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594a167f-dce3-4519-8cc2-7022938d5c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594a167f-dce3-4519-8cc2-7022938d5c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e95b42b-0182-47d9-b017-6d5b4f0dce11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:33 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Volume 6e3590b7-0504-4f8f-a115-f8c1d0700755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3590b7-0504-4f8f-a115-f8c1d0700755', 'volume_size': 1} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-352082424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3590b7-0504-4f8f-a115-f8c1d0700755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14dd7d4481f343a2b5e3bb77fd219ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:34Z,use_quota=True,user_id='0c9bce053578439c9b30bfe2be0c7f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Creating volume 6e3590b7-0504-4f8f-a115-f8c1d0700755 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:33 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e3590b7-0504-4f8f-a115-f8c1d0700755 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4581e185-c9c3-4d91-a603-a663039c47b2" returned: 0 in 0.719s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4581e185-c9c3-4d91-a603-a663039c47b2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:33 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e3590b7-0504-4f8f-a115-f8c1d0700755 1073741824 Sep 23 00:24:33 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wbn_avp0 Sep 23 00:24:33 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:33 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:33 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4581e185-c9c3-4d91-a603-a663039c47b2 Sep 23 00:24:33 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:34 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wbn_avp0" returned: 1 in 0.407s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_wbn_avp0' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9555116b-b6bb-424c-bd46-9e85705d1672]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:34 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4581e185-c9c3-4d91-a603-a663039c47b2" returned: 0 in 0.395s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-quobyte-4581e185-c9c3-4d91-a603-a663039c47b2" released by "delete_volume" :: held 1.192s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:34 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD Sep 23 00:24:34 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Created reservations ['fb803d7a-2c56-47bc-8915-ba523dada61d', '6f940706-cb4e-481c-8b63-db14d0e6862a', '6e341e73-0319-4e2a-a2a1-95cfd13f8ab1', '5a2e7a90-498d-4dee-98c0-6425805364e1'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:34 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:34 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:34 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e3590b7-0504-4f8f-a115-f8c1d0700755 1073741824" returned: 0 in 0.697s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e3590b7-0504-4f8f-a115-f8c1d0700755 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:34 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e3590b7-0504-4f8f-a115-f8c1d0700755 Sep 23 00:24:34 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:34 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD" returned: 0 in 0.562s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 was qcow2, converting to qcow2 {{(pid=86481) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:34 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 Sep 23 00:24:34 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:34 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.402s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:34 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Deleted volume successfully. Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dbfbf483-06be-4a4e-9b87-8f126f653b0e tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-4581e185-c9c3-4d91-a603-a663039c47b2-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:34 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e3590b7-0504-4f8f-a115-f8c1d0700755" returned: 0 in 0.324s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e95b42b-0182-47d9-b017-6d5b4f0dce11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3590b7-0504-4f8f-a115-f8c1d0700755', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f47099-45ec-48f7-b5fe-abc821cce9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:35 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Volume volume-6e3590b7-0504-4f8f-a115-f8c1d0700755 (6e3590b7-0504-4f8f-a115-f8c1d0700755): created successfully Sep 23 00:24:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f47099-45ec-48f7-b5fe-abc821cce9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Flow 'volume_create_manager' (3a404607-5631-4b8a-8862-149a3afb9c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:35 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d55ae132-bb5f-4639-8e73-80673f51e307 tempest-VolumesActionsTest-1046191595 None] Created volume successfully. Sep 23 00:24:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "cinder-0f4b4f30-0ef3-4735-95e6-74369b4dd219-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-0f4b4f30-0ef3-4735-95e6-74369b4dd219-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "cinder-quobyte-0f4b4f30-0ef3-4735-95e6-74369b4dd219" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-quobyte-0f4b4f30-0ef3-4735-95e6-74369b4dd219" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:35 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[06271517-adce-41ca-9895-046b7e79f800]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:35 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219 Sep 23 00:24:35 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:35 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219" returned: 0 in 0.555s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:36 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219 Sep 23 00:24:36 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:36 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f4b4f30-0ef3-4735-95e6-74369b4dd219" returned: 0 in 0.462s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-quobyte-0f4b4f30-0ef3-4735-95e6-74369b4dd219" released by "delete_volume" :: held 1.077s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Created reservations ['369026cf-f420-4bc1-875a-ebfe968c6c89', 'c47196c4-e4fe-4300-8ed2-3110502584ae', '7a3e5b47-b740-4e80-ae41-2ae37d54bc2f', '0dcdcb8d-c027-41e5-a376-cd5042a5ff65'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:36 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:36 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Acquiring lock "cinder-6e3590b7-0504-4f8f-a115-f8c1d0700755-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Lock "cinder-6e3590b7-0504-4f8f-a115-f8c1d0700755-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Acquiring lock "cinder-quobyte-6e3590b7-0504-4f8f-a115-f8c1d0700755" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Lock "cinder-quobyte-6e3590b7-0504-4f8f-a115-f8c1d0700755" acquired by "delete_volume" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7e9729-6266-41ca-8915-b206a0db7be9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e3590b7-0504-4f8f-a115-f8c1d0700755 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:37 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.408s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Deleted volume successfully. Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f591bd06-2da9-4dd2-bd00-d519a02e890e tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-0f4b4f30-0ef3-4735-95e6-74369b4dd219-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:37 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e3590b7-0504-4f8f-a115-f8c1d0700755 Sep 23 00:24:37 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:37 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864" returned: 0 in 2.655s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_n41vk68mdevstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:24:37 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Converted 112.00 MB image at 42.17 MB/s Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:37 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 1G Sep 23 00:24:37 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:37 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e3590b7-0504-4f8f-a115-f8c1d0700755" returned: 0 in 0.613s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e3590b7-0504-4f8f-a115-f8c1d0700755 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:37 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e3590b7-0504-4f8f-a115-f8c1d0700755 Sep 23 00:24:37 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "cinder-bf498226-e6eb-4a0d-9e72-efd6eecbbd95-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-bf498226-e6eb-4a0d-9e72-efd6eecbbd95-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "cinder-quobyte-bf498226-e6eb-4a0d-9e72-efd6eecbbd95" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-quobyte-bf498226-e6eb-4a0d-9e72-efd6eecbbd95" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc02439-ceac-47b0-ac36-54f9260f995d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:37 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e3590b7-0504-4f8f-a115-f8c1d0700755" returned: 0 in 0.359s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Lock "cinder-quobyte-6e3590b7-0504-4f8f-a115-f8c1d0700755" released by "delete_volume" :: held 1.064s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Created reservations ['6df448b3-2417-4fca-8b88-7167b41871ee', '422d8313-683d-4e5d-bee0-7286a64137b3', 'f232884a-a074-4469-93d0-adc3e7d58546', '7bdccf91-b111-4022-822b-7913903e01fb'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:38 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95 Sep 23 00:24:38 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:38 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 1G" returned: 0 in 0.784s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Downloaded image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}])) to volume 2077193f-ffc7-4639-98aa-456119326864 successfully. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Temporary image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 for user 6ad7847ddb474a1e86a6c3ae5c7714ff is deleted. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Marking volume 2077193f-ffc7-4639-98aa-456119326864 as bootable. {{(pid=86481) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Copying metadata from image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 to 2077193f-ffc7-4639-98aa-456119326864. {{(pid=86481) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Creating volume glance metadata for volume 2077193f-ffc7-4639-98aa-456119326864 backed by image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86481) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:38 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:38 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec22da99-d816-45d7-b7ca-ca4c90edb60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2077193f-ffc7-4639-98aa-456119326864', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb61973d-8b41-4384-b463-9b29c64f17a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:38 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Volume volume-2077193f-ffc7-4639-98aa-456119326864 (2077193f-ffc7-4639-98aa-456119326864): created successfully Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb61973d-8b41-4384-b463-9b29c64f17a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Flow 'volume_create_manager' (2dde65c7-20f0-48af-97cb-a5e786e759a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:38 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-31806881-d9a8-4cdc-b573-42800fc23e0a tempest-VolumesExtendTest-1094715959 None] Created volume successfully. Sep 23 00:24:38 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95" returned: 0 in 0.709s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:38 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95 Sep 23 00:24:38 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:38 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.509s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:38 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Deleted volume successfully. Sep 23 00:24:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e9264456-9199-4de0-aae7-49c3aff1522f tempest-VolumesActionsTest-1046191595 None] Lock "cinder-6e3590b7-0504-4f8f-a115-f8c1d0700755-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5b6a9c44-f164-4493-a4da-f423ebdeac0b tempest-VolumesExtendTest-1094715959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5b6a9c44-f164-4493-a4da-f423ebdeac0b tempest-VolumesExtendTest-1094715959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[2978cba3-e28c-45a9-af5e-5c6e99e7b993]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5b6a9c44-f164-4493-a4da-f423ebdeac0b tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:39 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-bf498226-e6eb-4a0d-9e72-efd6eecbbd95" returned: 0 in 0.498s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-quobyte-bf498226-e6eb-4a0d-9e72-efd6eecbbd95" released by "delete_volume" :: held 1.267s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Created reservations ['ccc3431d-43de-446e-8ce5-f9d74f8b3a4f', 'dcbeb165-d370-4d1a-8743-0ebc78e2099a', '3b68892c-7964-4396-b773-6f4a377e640f', '57f7889e-b6aa-40b2-8c6d-6fe1131fb01e'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:39 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 Sep 23 00:24:39 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:39 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:39 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:39 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5b6a9c44-f164-4493-a4da-f423ebdeac0b tempest-VolumesExtendTest-1094715959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864" returned: 0 in 0.473s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5b6a9c44-f164-4493-a4da-f423ebdeac0b tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 2G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:39 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.353s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:39 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Deleted volume successfully. Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a8daecb-d87b-4a27-81a9-16a026caeb2b tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-bf498226-e6eb-4a0d-9e72-efd6eecbbd95-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5b6a9c44-f164-4493-a4da-f423ebdeac0b tempest-VolumesExtendTest-1094715959 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 2G" returned: 0 in 0.197s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5b6a9c44-f164-4493-a4da-f423ebdeac0b tempest-VolumesExtendTest-1094715959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.726s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:39 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5b6a9c44-f164-4493-a4da-f423ebdeac0b tempest-VolumesExtendTest-1094715959 None] Extend volume completed successfully. Sep 23 00:24:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "cinder-789b7c35-f26a-451a-955a-f404c2aec27b-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-789b7c35-f26a-451a-955a-f404c2aec27b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "cinder-quobyte-789b7c35-f26a-451a-955a-f404c2aec27b" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-quobyte-789b7c35-f26a-451a-955a-f404c2aec27b" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:40 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c28610-b528-4f30-a7bb-60fe8fb56545]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-789b7c35-f26a-451a-955a-f404c2aec27b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:40 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-789b7c35-f26a-451a-955a-f404c2aec27b Sep 23 00:24:40 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:40 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-789b7c35-f26a-451a-955a-f404c2aec27b" returned: 0 in 0.637s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-789b7c35-f26a-451a-955a-f404c2aec27b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:40 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-789b7c35-f26a-451a-955a-f404c2aec27b Sep 23 00:24:40 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "cinder-2077193f-ffc7-4639-98aa-456119326864-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-2077193f-ffc7-4639-98aa-456119326864-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "cinder-quobyte-2077193f-ffc7-4639-98aa-456119326864" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-quobyte-2077193f-ffc7-4639-98aa-456119326864" acquired by "delete_volume" :: waited 0.038s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a452f3-deac-425f-880e-3aa3842ea89a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:41 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-789b7c35-f26a-451a-955a-f404c2aec27b" returned: 0 in 0.494s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-quobyte-789b7c35-f26a-451a-955a-f404c2aec27b" released by "delete_volume" :: held 1.238s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Created reservations ['c5ca1310-37c1-4044-bc0a-9aeaac8c23fa', '337342b1-885e-4496-b10a-d7f669c3a299', '7052f6ce-7ae2-493e-a562-7e45782101ec', 'f2670591-b8d9-4318-af0c-4c34612efca1'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:41 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 Sep 23 00:24:41 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:41 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:41 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:41 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864" returned: 0 in 0.561s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:41 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864 Sep 23 00:24:41 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:41 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.349s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:41 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:42 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Deleted volume successfully. Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-52a33fa8-919a-4736-9f17-0c5e8c48b54d tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-789b7c35-f26a-451a-955a-f404c2aec27b-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:42 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2077193f-ffc7-4639-98aa-456119326864" returned: 0 in 0.295s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-quobyte-2077193f-ffc7-4639-98aa-456119326864" released by "delete_volume" :: held 0.926s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Created reservations ['28a33acd-32a5-477e-ac44-d36800e6d668', 'fb1af1b7-a28d-4853-965d-0b7942a03b57', '711eeb62-b5ce-4b60-ac78-7d4eb478f636', '72720482-a34d-41a4-aba3-8552045b807e'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:42 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:42 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "cinder-594e7d56-027d-471d-9b6d-a1cf2e88f171-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-594e7d56-027d-471d-9b6d-a1cf2e88f171-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "cinder-quobyte-594e7d56-027d-471d-9b6d-a1cf2e88f171" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-quobyte-594e7d56-027d-471d-9b6d-a1cf2e88f171" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4d5f63-3ba2-4c5c-9c87-c1042c0364e0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-594e7d56-027d-471d-9b6d-a1cf2e88f171 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:42 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-594e7d56-027d-471d-9b6d-a1cf2e88f171 Sep 23 00:24:42 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:42 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.404s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:42 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Deleted volume successfully. Sep 23 00:24:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6041cfac-0d16-4303-8be2-a7cbb8759b41 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-2077193f-ffc7-4639-98aa-456119326864-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:43 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-594e7d56-027d-471d-9b6d-a1cf2e88f171" returned: 0 in 0.474s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-594e7d56-027d-471d-9b6d-a1cf2e88f171 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:43 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-594e7d56-027d-471d-9b6d-a1cf2e88f171 Sep 23 00:24:43 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:43 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-594e7d56-027d-471d-9b6d-a1cf2e88f171" returned: 0 in 0.345s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-quobyte-594e7d56-027d-471d-9b6d-a1cf2e88f171" released by "delete_volume" :: held 0.889s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:43 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Created reservations ['440d841c-192d-4d25-8e65-b338016ea6aa', '669ba939-3c98-44d4-887c-db78d6f03384', 'b1854f65-3d8c-4d13-bca5-dcf2a56c5e70', 'dc6a1184-74d1-4633-9ec7-8ae100e83d75'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:43 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:43 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:44 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.381s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:44 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Deleted volume successfully. Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Flow 'volume_create_manager' (6d5c3215-65c2-423c-ad20-8a24b391bac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44c2257-cd94-48a9-880c-ba9c2a6a599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44c2257-cd94-48a9-880c-ba9c2a6a599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2093332634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4900b653-a0cf-44f0-a47d-3c96c82aee24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a07a8fa1458d938fc55cc68b25a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:44Z,use_quota=True,user_id='6ad7847ddb474a1e86a6c3ae5c7714ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3805dd41-531b-429c-82da-137d728ca3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3805dd41-531b-429c-82da-137d728ca3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6df8f8-42b5-421f-a6ec-25b9c82e86e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6df8f8-42b5-421f-a6ec-25b9c82e86e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4900b653-a0cf-44f0-a47d-3c96c82aee24', 'volume_name': 'volume-4900b653-a0cf-44f0-a47d-3c96c82aee24', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbe18ba-ae38-4ccb-afd7-eec46e2a95ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbe18ba-ae38-4ccb-afd7-eec46e2a95ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75c634c-0394-477b-a336-75c74e6d3d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:44 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Volume 4900b653-a0cf-44f0-a47d-3c96c82aee24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4900b653-a0cf-44f0-a47d-3c96c82aee24', 'volume_size': 1} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2093332634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4900b653-a0cf-44f0-a47d-3c96c82aee24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff56a07a8fa1458d938fc55cc68b25a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:44Z,use_quota=True,user_id='6ad7847ddb474a1e86a6c3ae5c7714ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Creating volume 4900b653-a0cf-44f0-a47d-3c96c82aee24 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:44 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-50d1eb0d-fe72-474b-abca-f6e8cd89c631 tempest-CreateVolumesFromImageTest-820323737 None] Lock "cinder-594e7d56-027d-471d-9b6d-a1cf2e88f171-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:44 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 1073741824 Sep 23 00:24:44 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:45 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:45 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:45 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 1073741824" returned: 0 in 0.882s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:45 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 Sep 23 00:24:45 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:45 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.425s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:24:45 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24" returned: 0 in 0.332s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75c634c-0394-477b-a336-75c74e6d3d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4900b653-a0cf-44f0-a47d-3c96c82aee24', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09ce6be-f5cc-4aa9-9a5d-98d6ee461b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:45 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Volume volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 (4900b653-a0cf-44f0-a47d-3c96c82aee24): created successfully Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09ce6be-f5cc-4aa9-9a5d-98d6ee461b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Flow 'volume_create_manager' (6d5c3215-65c2-423c-ad20-8a24b391bac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:45 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5c53744b-8a71-40ce-9784-2ec4f4852163 tempest-VolumesExtendTest-1094715959 None] Created volume successfully. Sep 23 00:24:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] Creating offline snapshot 65d64d07-3baf-4eec-a7f6-3ce31dc6010a of volume 4900b653-a0cf-44f0-a47d-3c96c82aee24 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:24:46 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[974e7bcb-3a0a-4576-a3d7-c9a70fa8a7f9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:46 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 Sep 23 00:24:46 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:46 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24" returned: 0 in 0.464s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:47 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a 1G Sep 23 00:24:47 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:47 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a 1G" returned: 0 in 0.570s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:47 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a Sep 23 00:24:47 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:48 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a" returned: 0 in 0.459s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:48 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a is being set with open permissions: ugo+rw Sep 23 00:24:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:48 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a Sep 23 00:24:48 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:48 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a" returned: 0 in 0.351s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:48 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.info Sep 23 00:24:48 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:48 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.info" returned: 0 in 0.543s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:48 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.info is being set with open permissions: ugo+rw Sep 23 00:24:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:49 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.info Sep 23 00:24:49 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:49 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.info" returned: 0 in 0.355s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.881s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:49 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0a05ce3a-59d7-4e93-a2f3-b78e48f1fb94 tempest-VolumesExtendTest-1094715959 None] Create snapshot completed successfully Sep 23 00:24:49 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Flow 'volume_create_manager' (23500777-6ca8-4428-87d0-920141b4283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093fbd83-ef16-4fb4-8ad3-f57e1237f433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a1ac1235-0237-4dd7-ba7f-81c7ade45d78 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a1ac1235-0237-4dd7-ba7f-81c7ade45d78 tempest-VolumesExtendTest-1094715959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093fbd83-ef16-4fb4-8ad3-f57e1237f433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1719932590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9407b1-852b-436d-b1be-962b325d2e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd3d33fa3ba4a2baf1e75a1df92f6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:50Z,use_quota=True,user_id='3271e2654afe487f83fb0b8283b9db0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971d5672-0dbc-443b-9b41-13151be7a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971d5672-0dbc-443b-9b41-13151be7a416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af52d53-4a4c-4998-8d5a-7528ab01582f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af52d53-4a4c-4998-8d5a-7528ab01582f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f9407b1-852b-436d-b1be-962b325d2e99', 'volume_name': 'volume-0f9407b1-852b-436d-b1be-962b325d2e99', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1914986-3a62-4b44-8e02-134427edbdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1914986-3a62-4b44-8e02-134427edbdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f9864d-b6e3-467c-88c4-9fe6e24b1c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:50 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Volume 0f9407b1-852b-436d-b1be-962b325d2e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f9407b1-852b-436d-b1be-962b325d2e99', 'volume_size': 1} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8849a7a2-cf93-47b5-b5b5-c7d4566a8276]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a1ac1235-0237-4dd7-ba7f-81c7ade45d78 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:50 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 Sep 23 00:24:50 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:50 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a1ac1235-0237-4dd7-ba7f-81c7ade45d78 tempest-VolumesExtendTest-1094715959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24" returned: 0 in 0.482s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a1ac1235-0237-4dd7-ba7f-81c7ade45d78 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a 2G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a1ac1235-0237-4dd7-ba7f-81c7ade45d78 tempest-VolumesExtendTest-1094715959 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a 2G" returned: 0 in 0.250s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a1ac1235-0237-4dd7-ba7f-81c7ade45d78 tempest-VolumesExtendTest-1094715959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.867s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.786s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1719932590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9407b1-852b-436d-b1be-962b325d2e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd3d33fa3ba4a2baf1e75a1df92f6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:50Z,use_quota=True,user_id='3271e2654afe487f83fb0b8283b9db0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Creating volume 0f9407b1-852b-436d-b1be-962b325d2e99 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:50 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:50 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 1073741824 Sep 23 00:24:50 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:50 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=161,cinder:UPDATE=197,cinder:DELETE=17,cinder:INSERT=46 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:50 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a1ac1235-0237-4dd7-ba7f-81c7ade45d78 tempest-VolumesExtendTest-1094715959 None] Extend volume completed successfully. Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "cinder-65d64d07-3baf-4eec-a7f6-3ce31dc6010a-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-65d64d07-3baf-4eec-a7f6-3ce31dc6010a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "cinder-quobyte-4900b653-a0cf-44f0-a47d-3c96c82aee24" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-quobyte-4900b653-a0cf-44f0-a47d-3c96c82aee24" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "cinder-quobyte-65d64d07-3baf-4eec-a7f6-3ce31dc6010a" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-quobyte-65d64d07-3baf-4eec-a7f6-3ce31dc6010a" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Deleting offline snapshot 65d64d07-3baf-4eec-a7f6-3ce31dc6010a of volume 4900b653-a0cf-44f0-a47d-3c96c82aee24 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] snapshot_file for this snap is: volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c887f6-eb90-4608-9526-e52e8466dfd4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:51 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 1073741824" returned: 0 in 0.724s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=142,cinder:INSERT=53,cinder:UPDATE=194,cinder:DELETE=16 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:51 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a Sep 23 00:24:51 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:51 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 Sep 23 00:24:51 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:52 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99" returned: 0 in 0.398s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f9864d-b6e3-467c-88c4-9fe6e24b1c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f9407b1-852b-436d-b1be-962b325d2e99', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e6df2e-09d5-4fe0-893b-ebd71a2b342d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:52 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a" returned: 0 in 0.591s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4900b653-a0cf-44f0-a47d-3c96c82aee24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:24:52 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Volume volume-0f9407b1-852b-436d-b1be-962b325d2e99 (0f9407b1-852b-436d-b1be-962b325d2e99): created successfully Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e6df2e-09d5-4fe0-893b-ebd71a2b342d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Flow 'volume_create_manager' (23500777-6ca8-4428-87d0-920141b4283b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e373dc86-fbde-44bc-8343-9e707ccfccfd]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:52 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-980b1cd5-d131-4bce-ad32-cecf1580e3ee tempest-VolumeDependencyTests-356823552 None] Created volume successfully. Sep 23 00:24:52 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 Sep 23 00:24:52 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:52 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24" returned: 0 in 0.558s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:52 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a Sep 23 00:24:52 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:53 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a" returned: 0 in 0.585s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:53 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a Sep 23 00:24:53 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] Creating offline snapshot 39021621-dcc1-4cc4-a5d4-883e5f97c08a of volume 0f9407b1-852b-436d-b1be-962b325d2e99 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:24:53 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc7c191-8c7b-4427-bb38-1f10c379372b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:53 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24.65d64d07-3baf-4eec-a7f6-3ce31dc6010a" returned: 0 in 0.502s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:53 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 Sep 23 00:24:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-quobyte-65d64d07-3baf-4eec-a7f6-3ce31dc6010a" released by "_delete_snapshot" :: held 2.435s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:53 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-quobyte-4900b653-a0cf-44f0-a47d-3c96c82aee24" released by "delete_snapshot" :: held 2.479s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:54 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Created reservations ['1df32bb9-2cc0-4481-b72a-da1bfe65f5d5', 'e73d8839-4d39-40de-b05a-ae23aec8ae6c', '2d69c1e5-9e55-4f18-986e-2195995513f0', '09bdb00b-bf69-4d66-9cf0-d445ed6d0e6d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:54 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Delete snapshot completed successfully. Sep 23 00:24:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a4192790-7222-4e7b-856a-c4d7041ef084 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-65d64d07-3baf-4eec-a7f6-3ce31dc6010a-delete_snapshot" released by "delete_snapshot" :: held 2.765s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:54 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99" returned: 0 in 0.631s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:54 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a 1G Sep 23 00:24:54 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "cinder-4900b653-a0cf-44f0-a47d-3c96c82aee24-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-4900b653-a0cf-44f0-a47d-3c96c82aee24-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "cinder-quobyte-4900b653-a0cf-44f0-a47d-3c96c82aee24" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-quobyte-4900b653-a0cf-44f0-a47d-3c96c82aee24" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:55 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:55 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec9fd04-c0ff-4402-ab14-8bcecc23ce23]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a 1G" returned: 0 in 0.777s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f9407b1-852b-436d-b1be-962b325d2e99 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:55 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f9407b1-852b-436d-b1be-962b325d2e99 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a Sep 23 00:24:55 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:55 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 Sep 23 00:24:55 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:55 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f9407b1-852b-436d-b1be-962b325d2e99 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a" returned: 0 in 0.471s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:55 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a is being set with open permissions: ugo+rw Sep 23 00:24:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:55 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a Sep 23 00:24:55 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:55 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24" returned: 0 in 0.645s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:55 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24 Sep 23 00:24:55 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:55 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a" returned: 0 in 0.361s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:56 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.info Sep 23 00:24:56 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:56 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4900b653-a0cf-44f0-a47d-3c96c82aee24" returned: 0 in 0.498s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-quobyte-4900b653-a0cf-44f0-a47d-3c96c82aee24" released by "delete_volume" :: held 1.271s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Created reservations ['24591ed4-3bdf-40f4-9641-e1b0d3743f74', 'c8b793f7-dabb-4ff6-8f06-cdf9a5367360', 'c9f1ee92-0bc9-42f0-99f4-6b964dcde829', 'cc4eb91a-5699-49ea-b5f6-5a061d006bcb'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:24:56 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.info" returned: 0 in 0.391s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:56 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.info is being set with open permissions: ugo+rw Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:56 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.info Sep 23 00:24:56 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:56 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:24:56 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:56 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.info" returned: 0 in 0.411s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.228s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:56 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6c5ca970-d475-4a2e-be9d-acf72b175241 tempest-VolumeDependencyTests-356823552 None] Create snapshot completed successfully Sep 23 00:24:56 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.451s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:56 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Deleted volume successfully. Sep 23 00:24:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e26a2d52-da51-4392-85f8-02d8311533f8 tempest-VolumesExtendTest-1094715959 None] Lock "cinder-4900b653-a0cf-44f0-a47d-3c96c82aee24-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:58 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Flow 'volume_create_manager' (b54f10b1-1544-4026-a10c-2a0ceaa487b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a66c60e-d9c0-41e7-9344-22e6afcadff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a66c60e-d9c0-41e7-9344-22e6afcadff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1376213609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e66347-8fca-417c-803f-aebe89a2cc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bd3d33fa3ba4a2baf1e75a1df92f6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39021621-dcc1-4cc4-a5d4-883e5f97c08a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:59Z,use_quota=True,user_id='3271e2654afe487f83fb0b8283b9db0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2964529-956c-472c-a874-abe5198e302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2964529-956c-472c-a874-abe5198e302e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3ccfec-a779-4101-afac-dd99f2ac9c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3ccfec-a779-4101-afac-dd99f2ac9c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '11e66347-8fca-417c-803f-aebe89a2cc4b', 'volume_name': 'volume-11e66347-8fca-417c-803f-aebe89a2cc4b', 'volume_size': 1, 'snapshot_id': '39021621-dcc1-4cc4-a5d4-883e5f97c08a'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a498bd63-6f93-4292-aacd-7c9f08f5a9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a498bd63-6f93-4292-aacd-7c9f08f5a9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b99576-fc19-412e-ad8f-e46485801d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:59 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Volume 11e66347-8fca-417c-803f-aebe89a2cc4b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-11e66347-8fca-417c-803f-aebe89a2cc4b', 'volume_size': 1, 'snapshot_id': '39021621-dcc1-4cc4-a5d4-883e5f97c08a'} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Acquiring lock "cinder-quobyte-39021621-dcc1-4cc4-a5d4-883e5f97c08a-11e66347-8fca-417c-803f-aebe89a2cc4b" by "_create_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-quobyte-39021621-dcc1-4cc4-a5d4-883e5f97c08a-11e66347-8fca-417c-803f-aebe89a2cc4b" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Creating volume 11e66347-8fca-417c-803f-aebe89a2cc4b from snapshot 39021621-dcc1-4cc4-a5d4-883e5f97c08a {{(pid=86481) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Acquiring lock "cinder-quobyte-11e66347-8fca-417c-803f-aebe89a2cc4b" by "_copy_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-quobyte-11e66347-8fca-417c-803f-aebe89a2cc4b" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] snapshot: 39021621-dcc1-4cc4-a5d4-883e5f97c08a, volume: 11e66347-8fca-417c-803f-aebe89a2cc4b, {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cf6ee6-bef5-4f9c-be63-621de1daebc8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:59 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a Sep 23 00:24:59 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:00 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a" returned: 0 in 0.720s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f9407b1-852b-436d-b1be-962b325d2e99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:00 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1611626b-b9bb-4c9a-a908-c6cfc1d7c76c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:00 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 Sep 23 00:25:00 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:00 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99" returned: 0 in 0.638s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:25:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Creating direct copy from snapshot {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:25:00 devstack cinder-volume[86481]: DEBUG cinder.utils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Path /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b not found in is_blk_device check {{(pid=86481) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:25:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:00 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b Sep 23 00:25:00 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=18,cinder:SELECT=15,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Flow 'volume_create_manager' (f591bdaa-520d-432a-9daa-d7db9687eaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7969ed0-7afb-4a15-9b25-abbeb633b493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7969ed0-7afb-4a15-9b25-abbeb633b493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2089247963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f589d0-86c3-4152-9653-13689be06f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b79632db9e4d8080e17f49c676a11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:09Z,use_quota=True,user_id='8ff69e951dab4ff48fa2b876a6e0bc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc16d13-dd21-4f85-829c-b1e12f6544c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc16d13-dd21-4f85-829c-b1e12f6544c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d22ef53-73e3-4b47-a40b-edce508c99cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d22ef53-73e3-4b47-a40b-edce508c99cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f589d0-86c3-4152-9653-13689be06f6c', 'volume_name': 'volume-b6f589d0-86c3-4152-9653-13689be06f6c', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639cd9e9-6810-4851-8f68-b5bad0c11912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639cd9e9-6810-4851-8f68-b5bad0c11912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c48b6c7-17b2-47ff-ba55-8d85ddbe41e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:09 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Volume b6f589d0-86c3-4152-9653-13689be06f6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f589d0-86c3-4152-9653-13689be06f6c', 'volume_size': 1} Sep 23 00:25:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:10 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b" returned: 0 in 9.751s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:10 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99, size 1024.00 MB, duration 9.75 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:25:10 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Converted 1024.00 MB image at 105.00 MB/s Sep 23 00:25:10 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b is being set with open permissions: ugo+rw Sep 23 00:25:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:10 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b Sep 23 00:25:10 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:10 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b" returned: 0 in 0.341s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-quobyte-11e66347-8fca-417c-803f-aebe89a2cc4b" released by "_copy_volume_from_snapshot" :: held 11.712s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-quobyte-39021621-dcc1-4cc4-a5d4-883e5f97c08a-11e66347-8fca-417c-803f-aebe89a2cc4b" released by "_create_volume_from_snapshot" :: held 11.885s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.912s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.275s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2089247963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f589d0-86c3-4152-9653-13689be06f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b79632db9e4d8080e17f49c676a11c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:09Z,use_quota=True,user_id='8ff69e951dab4ff48fa2b876a6e0bc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Creating volume b6f589d0-86c3-4152-9653-13689be06f6c {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:11 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b99576-fc19-412e-ad8f-e46485801d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e66347-8fca-417c-803f-aebe89a2cc4b', 'volume_size': 1, 'snapshot_id': '39021621-dcc1-4cc4-a5d4-883e5f97c08a'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:11 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c 1073741824 Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2acb40-f5b3-456e-8302-2055aa9e56cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:11 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Volume volume-11e66347-8fca-417c-803f-aebe89a2cc4b (11e66347-8fca-417c-803f-aebe89a2cc4b): created successfully Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2acb40-f5b3-456e-8302-2055aa9e56cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Flow 'volume_create_manager' (b54f10b1-1544-4026-a10c-2a0ceaa487b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:11 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0a40c291-cbb1-4d6a-aac8-8d8464871fd0 tempest-VolumeDependencyTests-356823552 None] Created volume successfully. Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Acquiring lock "cinder-39021621-dcc1-4cc4-a5d4-883e5f97c08a-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-39021621-dcc1-4cc4-a5d4-883e5f97c08a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Acquiring lock "cinder-quobyte-0f9407b1-852b-436d-b1be-962b325d2e99" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-quobyte-0f9407b1-852b-436d-b1be-962b325d2e99" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Acquiring lock "cinder-quobyte-39021621-dcc1-4cc4-a5d4-883e5f97c08a" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-quobyte-39021621-dcc1-4cc4-a5d4-883e5f97c08a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Deleting offline snapshot 39021621-dcc1-4cc4-a5d4-883e5f97c08a of volume 0f9407b1-852b-436d-b1be-962b325d2e99 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] snapshot_file for this snap is: volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b93aae-9d19-4561-b998-7d0aa22a96ed]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:11 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a Sep 23 00:25:11 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:11 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c 1073741824" returned: 0 in 0.795s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:12 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c Sep 23 00:25:12 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:12 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a" returned: 0 in 0.622s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f9407b1-852b-436d-b1be-962b325d2e99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:12 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c" returned: 0 in 0.406s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c48b6c7-17b2-47ff-ba55-8d85ddbe41e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f589d0-86c3-4152-9653-13689be06f6c', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250f2557-2326-459d-84d6-13b356131b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:12 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c7c505-aa9c-4708-9557-dc5b8fdf5969]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:12 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Volume volume-b6f589d0-86c3-4152-9653-13689be06f6c (b6f589d0-86c3-4152-9653-13689be06f6c): created successfully Sep 23 00:25:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250f2557-2326-459d-84d6-13b356131b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Flow 'volume_create_manager' (f591bdaa-520d-432a-9daa-d7db9687eaf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:12 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4939d455-d847-4e67-b06d-7ed2679f1a1e tempest-SnapshotMetadataTestJSON-1841515839 None] Created volume successfully. Sep 23 00:25:12 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 Sep 23 00:25:12 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] Creating offline snapshot 05907347-5b43-43f0-955d-d9f4d699d0ee of volume b6f589d0-86c3-4152-9653-13689be06f6c {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:13 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c54005-0a1f-4f34-87f9-99426422a9c3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:13 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99" returned: 0 in 0.930s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:13 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c Sep 23 00:25:13 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:13 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a Sep 23 00:25:13 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:13 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c" returned: 0 in 0.576s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:13 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee 1G Sep 23 00:25:13 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:13 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a" returned: 0 in 0.514s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:13 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a Sep 23 00:25:13 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:14 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99.39021621-dcc1-4cc4-a5d4-883e5f97c08a" returned: 0 in 0.489s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-quobyte-39021621-dcc1-4cc4-a5d4-883e5f97c08a" released by "_delete_snapshot" :: held 2.784s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-quobyte-0f9407b1-852b-436d-b1be-962b325d2e99" released by "delete_snapshot" :: held 2.827s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:14 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee 1G" returned: 0 in 0.788s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f589d0-86c3-4152-9653-13689be06f6c -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:14 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Created reservations ['7add59f1-53bb-48ad-b394-34ec0cfeda5f', '19b806d3-eb30-42eb-af17-e4e559fea287', '2cbf937c-5e5a-4dbf-b8c5-099b50958f50', '976368ae-ce35-450e-b06e-2d0eb819e3c5'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:14 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f589d0-86c3-4152-9653-13689be06f6c -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee Sep 23 00:25:14 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:14 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Delete snapshot completed successfully. Sep 23 00:25:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9243d5e0-6a45-437b-a547-a7a3c299c878 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-39021621-dcc1-4cc4-a5d4-883e5f97c08a-delete_snapshot" released by "delete_snapshot" :: held 3.092s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Acquiring lock "cinder-0f9407b1-852b-436d-b1be-962b325d2e99-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Lock "cinder-0f9407b1-852b-436d-b1be-962b325d2e99-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:15 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f589d0-86c3-4152-9653-13689be06f6c -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee" returned: 0 in 0.528s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:15 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee is being set with open permissions: ugo+rw Sep 23 00:25:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:15 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee Sep 23 00:25:15 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Acquiring lock "cinder-quobyte-0f9407b1-852b-436d-b1be-962b325d2e99" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Lock "cinder-quobyte-0f9407b1-852b-436d-b1be-962b325d2e99" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:15 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90aa4bb-769e-4a53-bf46-a2b405970733]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:15 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 Sep 23 00:25:15 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:15 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee" returned: 0 in 0.359s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:15 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.info Sep 23 00:25:15 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:15 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.info" returned: 0 in 0.357s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:15 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.info is being set with open permissions: ugo+rw Sep 23 00:25:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:15 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99" returned: 0 in 0.635s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:15 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.info Sep 23 00:25:15 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:15 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99 Sep 23 00:25:15 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:16 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0f9407b1-852b-436d-b1be-962b325d2e99" returned: 0 in 0.426s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Lock "cinder-quobyte-0f9407b1-852b-436d-b1be-962b325d2e99" released by "delete_volume" :: held 1.184s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:16 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.info" returned: 0 in 0.566s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.304s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-922716dd-34a1-4443-84e1-1fa64b1c1671 tempest-SnapshotMetadataTestJSON-1841515839 None] Create snapshot completed successfully Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Created reservations ['7d26c0d4-a056-4f07-b196-59788bb9affd', 'd237a6b5-0e0c-4cf1-9d29-a428afcbc7d5', 'c1bf7135-8c7f-4989-95e2-366de59fca70', '3be65b59-a716-4eea-b928-65dadd95e784'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:16 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:25:16 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:16 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.310s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Deleted volume successfully. Sep 23 00:25:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e5e51d02-4e18-4967-b5c6-a1940cb79f7a tempest-VolumeDependencyTests-356823552 None] Lock "cinder-0f9407b1-852b-436d-b1be-962b325d2e99-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Acquiring lock "cinder-11e66347-8fca-417c-803f-aebe89a2cc4b-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-11e66347-8fca-417c-803f-aebe89a2cc4b-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Acquiring lock "cinder-quobyte-11e66347-8fca-417c-803f-aebe89a2cc4b" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-quobyte-11e66347-8fca-417c-803f-aebe89a2cc4b" acquired by "delete_volume" :: waited 0.044s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:17 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[818efbdd-b1d7-4f89-84e9-3889a07d1aa9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:17 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b Sep 23 00:25:17 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:18 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b" returned: 0 in 0.650s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:18 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b Sep 23 00:25:18 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:18 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-11e66347-8fca-417c-803f-aebe89a2cc4b" returned: 0 in 0.443s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-quobyte-11e66347-8fca-417c-803f-aebe89a2cc4b" released by "delete_volume" :: held 1.174s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:18 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Created reservations ['24b6b6d7-f62d-4327-93fa-34d9c056e945', 'c57bc822-87ba-4f06-b0de-0d9dc4324256', '3cbe7f56-8308-496c-8196-789df16531cd', '19c48222-a7c7-4839-9634-2dccdb098e15'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:19 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:25:19 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Acquiring lock "cinder-05907347-5b43-43f0-955d-d9f4d699d0ee-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "cinder-05907347-5b43-43f0-955d-d9f4d699d0ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Acquiring lock "cinder-quobyte-b6f589d0-86c3-4152-9653-13689be06f6c" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "cinder-quobyte-b6f589d0-86c3-4152-9653-13689be06f6c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Acquiring lock "cinder-quobyte-05907347-5b43-43f0-955d-d9f4d699d0ee" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "cinder-quobyte-05907347-5b43-43f0-955d-d9f4d699d0ee" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Deleting offline snapshot 05907347-5b43-43f0-955d-d9f4d699d0ee of volume b6f589d0-86c3-4152-9653-13689be06f6c {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] snapshot_file for this snap is: volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ee6d32-e789-46fd-a8a2-2bb4a1c129bb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:19 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee Sep 23 00:25:19 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:19 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.525s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:19 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Deleted volume successfully. Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcceace1-cbf9-41ae-a417-db381114e074 tempest-VolumeDependencyTests-356823552 None] Lock "cinder-11e66347-8fca-417c-803f-aebe89a2cc4b-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:19 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee" returned: 0 in 0.693s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f589d0-86c3-4152-9653-13689be06f6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:20 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1f4b84-75f1-4f93-9767-c9b69d384445]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:20 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c Sep 23 00:25:20 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:20 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c" returned: 0 in 0.730s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:20 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee Sep 23 00:25:20 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:21 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee" returned: 0 in 0.531s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:21 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee Sep 23 00:25:21 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:21 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c.05907347-5b43-43f0-955d-d9f4d699d0ee" returned: 0 in 0.329s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "cinder-quobyte-05907347-5b43-43f0-955d-d9f4d699d0ee" released by "_delete_snapshot" :: held 2.550s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "cinder-quobyte-b6f589d0-86c3-4152-9653-13689be06f6c" released by "delete_snapshot" :: held 2.584s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:21 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Created reservations ['04078b0a-545f-4857-b8b1-2d5967e240d0', '0e29891f-d3a8-4a62-953c-43def5eb46a5', 'fbdadf1c-41b3-4373-8a7c-74ceff90f260', 'c367c843-070e-4782-afa2-95c5129765fa'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:21 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Delete snapshot completed successfully. Sep 23 00:25:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f5a2b4ca-1315-44cb-8078-f3aaf80a919f tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "cinder-05907347-5b43-43f0-955d-d9f4d699d0ee-delete_snapshot" released by "delete_snapshot" :: held 2.870s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Acquiring lock "cinder-b6f589d0-86c3-4152-9653-13689be06f6c-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "cinder-b6f589d0-86c3-4152-9653-13689be06f6c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Acquiring lock "cinder-quobyte-b6f589d0-86c3-4152-9653-13689be06f6c" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "cinder-quobyte-b6f589d0-86c3-4152-9653-13689be06f6c" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:22 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7290f86b-15a0-44a0-9276-309bb912eaab]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:22 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c Sep 23 00:25:22 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:23 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c" returned: 0 in 0.522s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:23 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c Sep 23 00:25:23 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:23 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6f589d0-86c3-4152-9653-13689be06f6c" returned: 0 in 0.435s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "cinder-quobyte-b6f589d0-86c3-4152-9653-13689be06f6c" released by "delete_volume" :: held 1.092s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:23 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Created reservations ['4b1ac621-81ad-41d1-bebb-feb9e4d5172f', 'd659afed-a10d-4c23-9a37-f9adea6875a9', '62f409d9-c321-4e91-a6d8-8efe64924287', 'fe6de6dc-8e62-4806-8540-75dd6e31cd3b'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:23 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:25:23 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:24 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.357s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:24 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:24 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Deleted volume successfully. Sep 23 00:25:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e64a512d-3961-4d9f-858c-bd15a71268f7 tempest-SnapshotMetadataTestJSON-1841515839 None] Lock "cinder-b6f589d0-86c3-4152-9653-13689be06f6c-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Flow 'volume_create_manager' (36e8ccac-b932-43c5-8ee2-4e6e45e17a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3e90bc-61ef-43c6-b476-60ae3c39981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3e90bc-61ef-43c6-b476-60ae3c39981f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605962476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79df44b-eb1f-4b45-9484-d3e2bedc1522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74aeb64943d647e1a4fd8ba3741503a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:30Z,use_quota=True,user_id='95f81612f31a4d1b9de49e3f2044f667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55253352-a256-4dc0-842d-6d81172c7bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55253352-a256-4dc0-842d-6d81172c7bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c6329c-e1c0-4ec0-a7c8-6ac5fe40ed86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c6329c-e1c0-4ec0-a7c8-6ac5fe40ed86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a79df44b-eb1f-4b45-9484-d3e2bedc1522', 'volume_name': 'volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da31ec43-3286-4718-8338-3d1c9a98919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da31ec43-3286-4718-8338-3d1c9a98919a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f75ad0-d202-4c0b-b658-e228c4cade14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:30 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Volume a79df44b-eb1f-4b45-9484-d3e2bedc1522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522', 'volume_size': 1} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605962476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79df44b-eb1f-4b45-9484-d3e2bedc1522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74aeb64943d647e1a4fd8ba3741503a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:30Z,use_quota=True,user_id='95f81612f31a4d1b9de49e3f2044f667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Creating volume a79df44b-eb1f-4b45-9484-d3e2bedc1522 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:30 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:25:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:30 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 1073741824 Sep 23 00:25:30 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:31 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Flow 'volume_create_manager' (fcee2e4e-60d5-4001-ba47-c30c9fd91c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2049c7ed-8676-4053-8d53-bfa8bb8599c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2049c7ed-8676-4053-8d53-bfa8bb8599c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2103865573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c59233e-b655-4df5-9261-f9b121fba3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='803a01ec72214553b92dcc6fb62ee109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:31Z,use_quota=True,user_id='fc6f3d16556646e181e58eea6999e440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb382e4-9dd1-4acc-aae8-d9c8b862287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb382e4-9dd1-4acc-aae8-d9c8b862287d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71798302-56b8-4f89-898c-26e18b87e674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:31 devstack cinder-volume[86481]: DEBUG cinder.image.glance [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Creating Keystone auth plugin from conf {{(pid=86481) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:25:31 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 1073741824" returned: 0 in 0.761s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:31 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 Sep 23 00:25:31 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:32 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522" returned: 0 in 0.467s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71798302-56b8-4f89-898c-26e18b87e674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c59233e-b655-4df5-9261-f9b121fba3dd', 'volume_name': 'volume-4c59233e-b655-4df5-9261-f9b121fba3dd', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1512990c-9fae-4c02-9d3e-2e64d0e6fa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1512990c-9fae-4c02-9d3e-2e64d0e6fa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4dcdad-36a1-40d2-93d4-6f49a10d33a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:32 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Volume 4c59233e-b655-4df5-9261-f9b121fba3dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c59233e-b655-4df5-9261-f9b121fba3dd', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Trying to clone 4c59233e-b655-4df5-9261-f9b121fba3dd from image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]). {{(pid=86481) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f75ad0-d202-4c0b-b658-e228c4cade14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a08445b-1b77-4175-8818-174134efd26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:32 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Volume volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 (a79df44b-eb1f-4b45-9484-d3e2bedc1522): created successfully Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a08445b-1b77-4175-8818-174134efd26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Flow 'volume_create_manager' (36e8ccac-b932-43c5-8ee2-4e6e45e17a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:32 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-18e8fafe-c450-4199-988d-aeb9cd123ea2 tempest-VolumesSnapshotTestJSON-1382101784 None] Created volume successfully. Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:25:32 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[047301b8-fa32-4ca4-8900-cb0f95d64e02]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:33 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD Sep 23 00:25:33 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Flow 'volume_create_manager' (dfdd069e-beba-4a2d-ad64-13e6e144f7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff40b37e-634b-4542-81ff-5d95be1c7ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff40b37e-634b-4542-81ff-5d95be1c7ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d35b06-ea6a-46d7-87e6-cf7421aadde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='021c1108d5aa4b748726d97abb95efbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:33Z,use_quota=True,user_id='535c377830bb4800933d045ff6e1dd82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a67207-8bd5-4bed-b6a2-4fe7762bd4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a67207-8bd5-4bed-b6a2-4fe7762bd4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a412b5c-2c74-4b84-88b7-dbc4a8d37a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG cinder.image.glance [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Creating Keystone auth plugin from conf {{(pid=86481) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:25:33 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD" returned: 0 in 0.724s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Temporary image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 is fetched for user fc6f3d16556646e181e58eea6999e440. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] Creating offline snapshot fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa of volume a79df44b-eb1f-4b45-9484-d3e2bedc1522 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39ceb1b-4d96-4488-870a-34bb8f7a99b7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad871bf3-55b9-49da-aaa6-fc77484ea47e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:33 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 Sep 23 00:25:33 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:33 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD Sep 23 00:25:33 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a412b5c-2c74-4b84-88b7-dbc4a8d37a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '18d35b06-ea6a-46d7-87e6-cf7421aadde1', 'volume_name': 'volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1', 'volume_size': 1, 'image_id': '8e0c4855-df37-4386-b5a0-0e6c193ba845', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e0c4855-df37-4386-b5a0-0e6c193ba845', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2280bd9a86640db8cec6ef6a0242ba8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '021c1108d5aa4b748726d97abb95efbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab6672291caaa59308ac19e433c75da573cbd46d34945dc9ded9ad8f5932a8d23b0a23f8be5ceacfe6844a27e95a8b873c7255212cfe9e0f8fab1afaa49e65fc', 'id': '8e0c4855-df37-4386-b5a0-0e6c193ba845', 'created_at': datetime.datetime(2026, 9, 22, 22, 25, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e0c4855-df37-4386-b5a0-0e6c193ba845/file', 'properties': {}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe434266-7c3b-419e-9865-d8f6534ab925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe434266-7c3b-419e-9865-d8f6534ab925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:34 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c3cd24-cb1d-489f-9fc0-84a74372826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:34 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Volume 18d35b06-ea6a-46d7-87e6-cf7421aadde1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1', 'volume_size': 1, 'image_id': '8e0c4855-df37-4386-b5a0-0e6c193ba845', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e0c4855-df37-4386-b5a0-0e6c193ba845', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2280bd9a86640db8cec6ef6a0242ba8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '021c1108d5aa4b748726d97abb95efbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab6672291caaa59308ac19e433c75da573cbd46d34945dc9ded9ad8f5932a8d23b0a23f8be5ceacfe6844a27e95a8b873c7255212cfe9e0f8fab1afaa49e65fc', 'id': '8e0c4855-df37-4386-b5a0-0e6c193ba845', 'created_at': datetime.datetime(2026, 9, 22, 22, 25, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e0c4855-df37-4386-b5a0-0e6c193ba845/file', 'properties': {}}, 'image_service': } Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Trying to clone 18d35b06-ea6a-46d7-87e6-cf7421aadde1 from image 8e0c4855-df37-4386-b5a0-0e6c193ba845 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e0c4855-df37-4386-b5a0-0e6c193ba845', 'metadata': {}}]). {{(pid=86481) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522" returned: 0 in 0.603s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:34 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:34 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa 1G Sep 23 00:25:34 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:25:34 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be1b046-bce3-4585-a32f-230db3ca0f4b]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:34 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD Sep 23 00:25:34 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:34 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa 1G" returned: 0 in 0.626s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:34 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa Sep 23 00:25:34 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:34 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD" returned: 0 in 0.498s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:35 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD Sep 23 00:25:35 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:35 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa" returned: 0 in 0.439s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:35 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa is being set with open permissions: ugo+rw Sep 23 00:25:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:35 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa Sep 23 00:25:35 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:35 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD" returned: 1 in 0.492s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:25:35 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Temporary image 8e0c4855-df37-4386-b5a0-0e6c193ba845 is fetched for user 535c377830bb4800933d045ff6e1dd82. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:25:35 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acb3054-c4dd-4460-8119-7e235bb30b6b]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:35 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD Sep 23 00:25:35 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:35 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa" returned: 0 in 0.438s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:35 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.info Sep 23 00:25:35 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:36 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD" returned: 0 in 0.512s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:36 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.info" returned: 0 in 0.341s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:36 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.info is being set with open permissions: ugo+rw Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:36 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD Sep 23 00:25:36 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:36 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.info Sep 23 00:25:36 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:36 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD" returned: 1 in 0.448s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:25:36 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.info" returned: 0 in 0.354s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.960s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.269s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2103865573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c59233e-b655-4df5-9261-f9b121fba3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='803a01ec72214553b92dcc6fb62ee109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:31Z,use_quota=True,user_id='fc6f3d16556646e181e58eea6999e440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Creating volume 4c59233e-b655-4df5-9261-f9b121fba3dd {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:36 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:25:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:36 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd 1073741824 Sep 23 00:25:36 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:36 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9b3d1093-7a7c-4c5c-9a8d-8ef38a833ce3 tempest-VolumesSnapshotTestJSON-1382101784 None] Create snapshot completed successfully Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-a79df44b-eb1f-4b45-9484-d3e2bedc1522" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-a79df44b-eb1f-4b45-9484-d3e2bedc1522" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Deleting offline snapshot fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa of volume a79df44b-eb1f-4b45-9484-d3e2bedc1522 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] snapshot_file for this snap is: volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8578705-54c4-4b3d-93a0-deceef5148e9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:37 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd 1073741824" returned: 0 in 0.793s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:37 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa Sep 23 00:25:37 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:37 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd Sep 23 00:25:37 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Flow 'volume_create_manager' (763f9e5f-4a50-4fb3-9697-3b0f8de34f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf18549-3369-4192-8d1d-3d9c5006b6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf18549-3369-4192-8d1d-3d9c5006b6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1719584858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c414689-d3c1-46eb-a483-a3bd32277936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ccd988fd1b4735b527b780ed9e2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:37Z,use_quota=True,user_id='97922e05323f4eb388c454560903a2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ca48ce-78a2-4ddd-9a56-20b58e14dd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ca48ce-78a2-4ddd-9a56-20b58e14dd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f96443-313f-4e27-a621-c1640a55b40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f96443-313f-4e27-a621-c1640a55b40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c414689-d3c1-46eb-a483-a3bd32277936', 'volume_name': 'volume-5c414689-d3c1-46eb-a483-a3bd32277936', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1df345-2871-45cb-880b-843ab2eb46c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1df345-2871-45cb-880b-843ab2eb46c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ecec2f-3a7e-44d3-9b02-5b12ea658646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:37 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Volume 5c414689-d3c1-46eb-a483-a3bd32277936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c414689-d3c1-46eb-a483-a3bd32277936', 'volume_size': 1} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:37 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd" returned: 0 in 0.281s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d35b06-ea6a-46d7-87e6-cf7421aadde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='021c1108d5aa4b748726d97abb95efbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:33Z,use_quota=True,user_id='535c377830bb4800933d045ff6e1dd82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Creating volume 18d35b06-ea6a-46d7-87e6-cf7421aadde1 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:37 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:37 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:37 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 1073741824 Sep 23 00:25:37 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Attempting download of 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}])) to volume 4c59233e-b655-4df5-9261-f9b121fba3dd. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa" returned: 0 in 0.503s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[075fab12-e8a1-415f-adbc-bf58113d7ae7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a588d965-d284-4073-b616-a4ce4bbc7e77]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_4huowje3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:37 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 Sep 23 00:25:37 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:37 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_4huowje3 Sep 23 00:25:37 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_4huowje3" returned: 0 in 0.424s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_4huowje3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 1073741824" returned: 0 in 0.580s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522" returned: 0 in 0.479s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa Sep 23 00:25:38 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 Sep 23 00:25:38 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_4huowje3 Sep 23 00:25:38 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_4huowje3" returned: 1 in 0.411s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_4huowje3' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b33283-e084-42a3-add6-eead8618dd6f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1" returned: 0 in 0.362s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:38 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.174s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1719584858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c414689-d3c1-46eb-a483-a3bd32277936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ccd988fd1b4735b527b780ed9e2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:37Z,use_quota=True,user_id='97922e05323f4eb388c454560903a2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Creating volume 5c414689-d3c1-46eb-a483-a3bd32277936 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:38 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa" returned: 0 in 0.446s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 1073741824 Sep 23 00:25:38 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Attempting download of 8e0c4855-df37-4386-b5a0-0e6c193ba845 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e0c4855-df37-4386-b5a0-0e6c193ba845', 'metadata': {}}])) to volume 18d35b06-ea6a-46d7-87e6-cf7421aadde1. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:25:38 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa Sep 23 00:25:38 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD Sep 23 00:25:38 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[443d8852-0fcb-4caa-b802-fe4f36d8ccf3]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e0c4855-df37-4386-b5a0-0e6c193ba845_kpvbtzs8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:38 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e0c4855-df37-4386-b5a0-0e6c193ba845_kpvbtzs8 Sep 23 00:25:39 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:39 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522.fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa" returned: 0 in 0.313s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa" released by "_delete_snapshot" :: held 1.928s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:39 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 was qcow2, converting to qcow2 {{(pid=86481) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-a79df44b-eb1f-4b45-9484-d3e2bedc1522" released by "delete_snapshot" :: held 1.985s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:39 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd Sep 23 00:25:39 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Created reservations ['51eb1b3f-05d9-48be-846e-b791ec696e68', '60cb30d5-99f6-4d23-a34e-c2308148ce52', '70c2d6d3-6b2f-4e0c-9b5e-7a1e5d71dcee', 'ead523e0-55d0-4116-b0d8-20d18d2cfd67'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:39 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e0c4855-df37-4386-b5a0-0e6c193ba845_kpvbtzs8" returned: 0 in 0.419s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e0c4855-df37-4386-b5a0-0e6c193ba845_kpvbtzs8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:39 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Delete snapshot completed successfully. Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e6133f99-fc18-4592-8e03-e49b6729b116 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-fde01b8e-2d8c-4fc8-8c0f-a44bdd6cfaaa-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:39 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 1073741824" returned: 0 in 0.631s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:39 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e0c4855-df37-4386-b5a0-0e6c193ba845_kpvbtzs8 Sep 23 00:25:39 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 Sep 23 00:25:39 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:39 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:39 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936" returned: 0 in 0.327s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ecec2f-3a7e-44d3-9b02-5b12ea658646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c414689-d3c1-46eb-a483-a3bd32277936', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67797ad-0203-4825-a324-02dd5b6b6e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:39 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e0c4855-df37-4386-b5a0-0e6c193ba845_kpvbtzs8" returned: 1 in 0.499s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e0c4855-df37-4386-b5a0-0e6c193ba845_kpvbtzs8' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1a0b01-dc54-48b8-815d-a9697c806ae4]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:39 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Volume volume-5c414689-d3c1-46eb-a483-a3bd32277936 (5c414689-d3c1-46eb-a483-a3bd32277936): created successfully Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67797ad-0203-4825-a324-02dd5b6b6e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Flow 'volume_create_manager' (763f9e5f-4a50-4fb3-9697-3b0f8de34f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:39 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-edd305f1-4db0-429b-ae2a-3be037988413 tempest-VolumesDeleteCascade-605394640 None] Created volume successfully. Sep 23 00:25:39 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD Sep 23 00:25:39 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:40 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:40 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD Sep 23 00:25:40 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:40 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD" returned: 1 in 0.525s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:25:40 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] 8e0c4855-df37-4386-b5a0-0e6c193ba845 was raw, converting to qcow2 {{(pid=86481) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:25:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:40 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 Sep 23 00:25:40 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] Creating offline snapshot 312695ba-93c5-4337-a8e1-dd8b8eb76356 of volume 5c414689-d3c1-46eb-a483-a3bd32277936 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef4e555-6c70-47a5-b1ff-1aa6f5249aaa]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:41 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 Sep 23 00:25:41 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Flow 'volume_create_manager' (f5e792d4-d370-455d-a120-59bdb3fd9179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d440981-ba64-4740-adc3-a7fcb2d51f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d440981-ba64-4740-adc3-a7fcb2d51f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1804407606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13a119e-1894-489a-97b4-ef6dc4c22e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74aeb64943d647e1a4fd8ba3741503a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:41Z,use_quota=True,user_id='95f81612f31a4d1b9de49e3f2044f667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9176b06c-ea8a-4bd3-93b1-92c2f1a4d0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9176b06c-ea8a-4bd3-93b1-92c2f1a4d0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b757a8-5b46-4d89-bd2e-2aa480e5d68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b757a8-5b46-4d89-bd2e-2aa480e5d68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13a119e-1894-489a-97b4-ef6dc4c22e9d', 'volume_name': 'volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28804f86-6c97-486c-bf5f-bb3f72e27f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28804f86-6c97-486c-bf5f-bb3f72e27f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0141fe3-360b-462e-a3db-064e97cbf841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:41 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Volume f13a119e-1894-489a-97b4-ef6dc4c22e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d', 'volume_size': 1} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:41 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1" returned: 0 in 0.795s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e0c4855-df37-4386-b5a0-0e6c193ba845_57z1ml48devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:25:41 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:41 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 1G Sep 23 00:25:41 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:41 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936" returned: 0 in 0.637s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:41 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd" returned: 0 in 2.633s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_0z6nzfqzdevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:25:41 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Converted 112.00 MB image at 42.50 MB/s Sep 23 00:25:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:41 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 1G Sep 23 00:25:41 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:41 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd 1G Sep 23 00:25:41 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:42 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 1G" returned: 0 in 0.510s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Downloaded image 8e0c4855-df37-4386-b5a0-0e6c193ba845 ((None, [{'url': 'file:///opt/stack/data/glance/images/8e0c4855-df37-4386-b5a0-0e6c193ba845', 'metadata': {}}])) to volume 18d35b06-ea6a-46d7-87e6-cf7421aadde1 successfully. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Temporary image 8e0c4855-df37-4386-b5a0-0e6c193ba845 for user 535c377830bb4800933d045ff6e1dd82 is deleted. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Marking volume 18d35b06-ea6a-46d7-87e6-cf7421aadde1 as bootable. {{(pid=86481) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Copying metadata from image 8e0c4855-df37-4386-b5a0-0e6c193ba845 to 18d35b06-ea6a-46d7-87e6-cf7421aadde1. {{(pid=86481) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Creating volume glance metadata for volume 18d35b06-ea6a-46d7-87e6-cf7421aadde1 backed by image 8e0c4855-df37-4386-b5a0-0e6c193ba845 with: {'image_id': '8e0c4855-df37-4386-b5a0-0e6c193ba845', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e2280bd9a86640db8cec6ef6a0242ba8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86481) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c3cd24-cb1d-489f-9fc0-84a74372826c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1', 'volume_size': 1, 'image_id': '8e0c4855-df37-4386-b5a0-0e6c193ba845', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e0c4855-df37-4386-b5a0-0e6c193ba845', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2280bd9a86640db8cec6ef6a0242ba8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '021c1108d5aa4b748726d97abb95efbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab6672291caaa59308ac19e433c75da573cbd46d34945dc9ded9ad8f5932a8d23b0a23f8be5ceacfe6844a27e95a8b873c7255212cfe9e0f8fab1afaa49e65fc', 'id': '8e0c4855-df37-4386-b5a0-0e6c193ba845', 'created_at': datetime.datetime(2026, 9, 22, 22, 25, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 25, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e0c4855-df37-4386-b5a0-0e6c193ba845/file', 'properties': {}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4f278a-a6aa-4c60-838f-6922e85ef446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:42 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:42 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Volume volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 (18d35b06-ea6a-46d7-87e6-cf7421aadde1): created successfully Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4f278a-a6aa-4c60-838f-6922e85ef446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Flow 'volume_create_manager' (dfdd069e-beba-4a2d-ad64-13e6e144f7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd 1G" returned: 0 in 0.504s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Downloaded image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}])) to volume 4c59233e-b655-4df5-9261-f9b121fba3dd successfully. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Temporary image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 for user fc6f3d16556646e181e58eea6999e440 is deleted. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Marking volume 4c59233e-b655-4df5-9261-f9b121fba3dd as bootable. {{(pid=86481) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:25:42 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9dc6b26f-91cd-493c-a16d-59e0e46ebc13 tempest-VolumeImageDependencyTests-1215279736 None] Created volume successfully. Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Copying metadata from image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 to 4c59233e-b655-4df5-9261-f9b121fba3dd. {{(pid=86481) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Creating volume glance metadata for volume 4c59233e-b655-4df5-9261-f9b121fba3dd backed by image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86481) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:25:42 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 1G" returned: 0 in 0.629s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c414689-d3c1-46eb-a483-a3bd32277936 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:42 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c414689-d3c1-46eb-a483-a3bd32277936 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 Sep 23 00:25:42 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4dcdad-36a1-40d2-93d4-6f49a10d33a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c59233e-b655-4df5-9261-f9b121fba3dd', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c04418-d00e-403c-8aa1-aaeb5ea87cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:42 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Volume volume-4c59233e-b655-4df5-9261-f9b121fba3dd (4c59233e-b655-4df5-9261-f9b121fba3dd): created successfully Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c04418-d00e-403c-8aa1-aaeb5ea87cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Flow 'volume_create_manager' (fcee2e4e-60d5-4001-ba47-c30c9fd91c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:42 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b3bcce7f-4344-4028-a0dd-8b046b1ea849 tempest-TestShelveInstance-7289932 None] Created volume successfully. Sep 23 00:25:42 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c414689-d3c1-46eb-a483-a3bd32277936 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356" returned: 0 in 0.393s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:42 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 is being set with open permissions: ugo+rw Sep 23 00:25:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:42 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 Sep 23 00:25:42 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:43 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356" returned: 0 in 0.260s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:43 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.info Sep 23 00:25:43 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Acquiring lock "cinder-18d35b06-ea6a-46d7-87e6-cf7421aadde1-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Lock "cinder-18d35b06-ea6a-46d7-87e6-cf7421aadde1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:43 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.info" returned: 0 in 0.349s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:43 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.info is being set with open permissions: ugo+rw Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:43 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.info Sep 23 00:25:43 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Acquiring lock "cinder-quobyte-18d35b06-ea6a-46d7-87e6-cf7421aadde1" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Lock "cinder-quobyte-18d35b06-ea6a-46d7-87e6-cf7421aadde1" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e97048-35ec-49f3-8f26-e84692dd6865]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:43 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 Sep 23 00:25:43 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:43 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.info" returned: 0 in 0.330s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.746s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.370s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1804407606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13a119e-1894-489a-97b4-ef6dc4c22e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74aeb64943d647e1a4fd8ba3741503a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:41Z,use_quota=True,user_id='95f81612f31a4d1b9de49e3f2044f667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Creating volume f13a119e-1894-489a-97b4-ef6dc4c22e9d {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:43 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:25:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:43 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d 1073741824 Sep 23 00:25:43 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:43 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7f8edb94-e31d-4f3f-b592-cf4cbaa0f594 tempest-VolumesDeleteCascade-605394640 None] Create snapshot completed successfully Sep 23 00:25:44 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1" returned: 0 in 0.599s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:44 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1 Sep 23 00:25:44 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:44 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d 1073741824" returned: 0 in 0.784s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:44 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-18d35b06-ea6a-46d7-87e6-cf7421aadde1" returned: 0 in 0.511s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:44 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d Sep 23 00:25:44 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Lock "cinder-quobyte-18d35b06-ea6a-46d7-87e6-cf7421aadde1" released by "delete_volume" :: held 1.191s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Created reservations ['17efdabd-7a5d-40a2-942a-847a5cc8bd90', '655e40b2-f0bc-4b00-9a01-25c086e94043', 'b1bea6d9-094f-4a07-bea2-ceb15117a5f6', '7f244722-2101-4484-af7a-5646e60e59e6'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:44 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:25:44 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:44 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d" returned: 0 in 0.371s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.513s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:45 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:25:45 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0141fe3-360b-462e-a3db-064e97cbf841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6c4dd5-2936-4b75-9915-257c0b5abaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] Creating offline snapshot e12547a4-9a10-451d-905d-b56b7010736e of volume 5c414689-d3c1-46eb-a483-a3bd32277936 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:45 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Volume volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d (f13a119e-1894-489a-97b4-ef6dc4c22e9d): created successfully Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6c4dd5-2936-4b75-9915-257c0b5abaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Flow 'volume_create_manager' (f5e792d4-d370-455d-a120-59bdb3fd9179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdaea81-12f9-436f-b183-9e441b40adba]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:45 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e2e27580-36d8-4ed8-8e81-4a888611f4d6 tempest-VolumesSnapshotTestJSON-1382101784 None] Created volume successfully. Sep 23 00:25:45 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.456s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:45 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Deleted volume successfully. Sep 23 00:25:45 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.381s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:25:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-56087a4c-12d9-4337-89ec-93b2618df8e0 tempest-VolumeImageDependencyTests-1215279736 None] Lock "cinder-18d35b06-ea6a-46d7-87e6-cf7421aadde1-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:45 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 Sep 23 00:25:45 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:46 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356" returned: 0 in 0.824s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c414689-d3c1-46eb-a483-a3bd32277936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:46 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e 1G Sep 23 00:25:46 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:46 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e 1G" returned: 0 in 0.697s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:46 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e Sep 23 00:25:46 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:47 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e" returned: 0 in 0.557s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:47 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e is being set with open permissions: ugo+rw Sep 23 00:25:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:47 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e Sep 23 00:25:47 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:47 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e" returned: 0 in 0.494s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.824s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.844s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-05dc419f-1095-48d4-b6a0-668421ef3af2 req-c274605d-4adb-42c0-a838-d33c3424fce5 tempest-TestShelveInstance-7289932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] Creating offline snapshot ad8dd7a2-1ce2-4d8b-81bc-804789937a82 of volume f13a119e-1894-489a-97b4-ef6dc4c22e9d {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:25:47 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e8a3745a-d84d-4ce8-bac2-08005ce36236 tempest-VolumesDeleteCascade-605394640 None] Create snapshot completed successfully Sep 23 00:25:47 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe4a611-394f-46ca-a666-9f073f64f58d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:48 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d Sep 23 00:25:48 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:48 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d" returned: 0 in 0.592s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:48 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 1G Sep 23 00:25:48 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-5c414689-d3c1-46eb-a483-a3bd32277936-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-5c414689-d3c1-46eb-a483-a3bd32277936-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Performing cascade delete. {{(pid=86481) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-312695ba-93c5-4337-a8e1-dd8b8eb76356-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-312695ba-93c5-4337-a8e1-dd8b8eb76356-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-quobyte-5c414689-d3c1-46eb-a483-a3bd32277936" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-5c414689-d3c1-46eb-a483-a3bd32277936" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-quobyte-312695ba-93c5-4337-a8e1-dd8b8eb76356" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-312695ba-93c5-4337-a8e1-dd8b8eb76356" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Deleting offline snapshot 312695ba-93c5-4337-a8e1-dd8b8eb76356 of volume 5c414689-d3c1-46eb-a483-a3bd32277936 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] snapshot_file for this snap is: volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3674d42-7fe6-45ae-aadc-318b903f3d7a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:49 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 1G" returned: 0 in 0.889s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:49 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 Sep 23 00:25:49 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:49 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 Sep 23 00:25:49 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:49 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:49 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356" returned: 0 in 0.702s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c414689-d3c1-46eb-a483-a3bd32277936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82" returned: 0 in 0.624s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:50 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 is being set with open permissions: ugo+rw Sep 23 00:25:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:50 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1683bf84-2c79-454e-adab-9e1e67152f21]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:50 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 Sep 23 00:25:50 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:50 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 Sep 23 00:25:50 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:50 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82" returned: 0 in 0.532s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:50 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.info Sep 23 00:25:50 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:50 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936" returned: 0 in 0.644s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:50 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf795dd-bb80-4823-bf75-d909670cb054]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:51 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e Sep 23 00:25:51 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:51 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.info" returned: 0 in 0.500s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:51 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.info is being set with open permissions: ugo+rw Sep 23 00:25:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:51 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.info Sep 23 00:25:51 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:51 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e" returned: 0 in 0.697s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c414689-d3c1-46eb-a483-a3bd32277936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:51 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[66936e27-4e1e-4e4a-b73b-3c20b8081179]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:51 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.info" returned: 0 in 0.512s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.844s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-05dc419f-1095-48d4-b6a0-668421ef3af2 req-c274605d-4adb-42c0-a838-d33c3424fce5 tempest-TestShelveInstance-7289932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.832s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:51 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=94,cinder:DELETE=12,cinder:SELECT=105,cinder:INSERT=41 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:51 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 Sep 23 00:25:51 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-05dc419f-1095-48d4-b6a0-668421ef3af2 req-c274605d-4adb-42c0-a838-d33c3424fce5 tempest-TestShelveInstance-7289932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:51 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-76c779f1-356f-436b-b7e6-2717f5e3ee09 tempest-VolumesSnapshotTestJSON-1382101784 None] Create snapshot completed successfully Sep 23 00:25:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-05dc419f-1095-48d4-b6a0-668421ef3af2 req-c274605d-4adb-42c0-a838-d33c3424fce5 tempest-TestShelveInstance-7289932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-4c59233e-b655-4df5-9261-f9b121fba3dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '303e9dc3-2dde-4375-99c6-966d95feae23', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:25:51 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-05dc419f-1095-48d4-b6a0-668421ef3af2 req-c274605d-4adb-42c0-a838-d33c3424fce5 tempest-TestShelveInstance-7289932 None] attachment_update completed successfully. Sep 23 00:25:52 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356" returned: 0 in 0.665s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c414689-d3c1-46eb-a483-a3bd32277936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:52 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2c6d4d-e327-46ec-b4da-07c593bd12e4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:52 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 Sep 23 00:25:52 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:53 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936" returned: 0 in 0.781s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:53 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 Sep 23 00:25:53 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:54 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356" returned: 0 in 1.018s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:54 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356 Sep 23 00:25:54 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Flow 'volume_create_manager' (67728059-40cb-4290-af6d-d2ade1da50bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0fe788-69b6-44b0-bd37-fc7717cdda05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0fe788-69b6-44b0-bd37-fc7717cdda05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-113600076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975d2195-55b4-4859-882b-d6743bdce3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74aeb64943d647e1a4fd8ba3741503a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ad8dd7a2-1ce2-4d8b-81bc-804789937a82,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:54Z,use_quota=True,user_id='95f81612f31a4d1b9de49e3f2044f667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd68f1c7-0742-4468-b117-b123ec4fdada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd68f1c7-0742-4468-b117-b123ec4fdada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773ef5a8-f2ca-4c3f-8326-190e8f92b213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773ef5a8-f2ca-4c3f-8326-190e8f92b213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '975d2195-55b4-4859-882b-d6743bdce3f2', 'volume_name': 'volume-975d2195-55b4-4859-882b-d6743bdce3f2', 'volume_size': 2, 'snapshot_id': 'ad8dd7a2-1ce2-4d8b-81bc-804789937a82'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313290f9-866a-4f59-adcf-cb936c86b5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313290f9-866a-4f59-adcf-cb936c86b5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409915bd-c43a-4b9d-8238-aa950112dfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:54 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Volume 975d2195-55b4-4859-882b-d6743bdce3f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-975d2195-55b4-4859-882b-d6743bdce3f2', 'volume_size': 2, 'snapshot_id': 'ad8dd7a2-1ce2-4d8b-81bc-804789937a82'} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-ad8dd7a2-1ce2-4d8b-81bc-804789937a82-975d2195-55b4-4859-882b-d6743bdce3f2" by "_create_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-ad8dd7a2-1ce2-4d8b-81bc-804789937a82-975d2195-55b4-4859-882b-d6743bdce3f2" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Creating volume 975d2195-55b4-4859-882b-d6743bdce3f2 from snapshot ad8dd7a2-1ce2-4d8b-81bc-804789937a82 {{(pid=86481) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:54 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-975d2195-55b4-4859-882b-d6743bdce3f2" by "_copy_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.312695ba-93c5-4337-a8e1-dd8b8eb76356" returned: 0 in 0.680s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c414689-d3c1-46eb-a483-a3bd32277936 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e -F qcow2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-975d2195-55b4-4859-882b-d6743bdce3f2" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] snapshot: ad8dd7a2-1ce2-4d8b-81bc-804789937a82, volume: 975d2195-55b4-4859-882b-d6743bdce3f2, {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:25:54 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c414689-d3c1-46eb-a483-a3bd32277936 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e -F qcow2 Sep 23 00:25:54 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47a297c-4120-41b7-907a-94b24c228306]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:55 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 Sep 23 00:25:55 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:55 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c414689-d3c1-46eb-a483-a3bd32277936 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e -F qcow2" returned: 0 in 0.575s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-312695ba-93c5-4337-a8e1-dd8b8eb76356" released by "_delete_snapshot" :: held 6.122s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-5c414689-d3c1-46eb-a483-a3bd32277936" released by "delete_snapshot" :: held 6.167s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Created reservations ['00483126-febe-4abf-b7c2-a25475fdd073', '54e6d03d-51b5-422f-8681-a7ee6dfd950b', '93c5f200-dbd4-4232-89d6-5b4df4276a92', '51190b0d-1d4f-4604-baa4-7d200e9e6497'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:25:55 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82" returned: 0 in 0.609s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[533d6ca4-d51b-449e-829e-aef06c5cac1d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:55 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Delete snapshot completed successfully. Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-312695ba-93c5-4337-a8e1-dd8b8eb76356-delete_snapshot" released by "delete_snapshot" :: held 6.450s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-e12547a4-9a10-451d-905d-b56b7010736e-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-e12547a4-9a10-451d-905d-b56b7010736e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-quobyte-5c414689-d3c1-46eb-a483-a3bd32277936" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-5c414689-d3c1-46eb-a483-a3bd32277936" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-quobyte-e12547a4-9a10-451d-905d-b56b7010736e" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-e12547a4-9a10-451d-905d-b56b7010736e" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:55 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d Sep 23 00:25:55 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Deleting offline snapshot e12547a4-9a10-451d-905d-b56b7010736e of volume 5c414689-d3c1-46eb-a483-a3bd32277936 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] snapshot_file for this snap is: volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9277d996-7e8e-4153-9406-5c02aaabd518]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:56 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e Sep 23 00:25:56 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:56 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d" returned: 0 in 0.976s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:25:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Creating direct copy from snapshot {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:25:56 devstack cinder-volume[86481]: DEBUG cinder.utils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Path /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2 not found in is_blk_device check {{(pid=86481) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:25:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:56 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2 Sep 23 00:25:56 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:56 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e" returned: 0 in 0.966s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c414689-d3c1-46eb-a483-a3bd32277936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:25:56 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd0c228-9684-4fa9-ba9f-b36e2bc719eb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:57 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 Sep 23 00:25:57 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:57 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936" returned: 0 in 0.999s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:57 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e Sep 23 00:25:57 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:59 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e" returned: 0 in 1.532s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:59 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e Sep 23 00:25:59 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:00 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936.e12547a4-9a10-451d-905d-b56b7010736e" returned: 0 in 1.158s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-e12547a4-9a10-451d-905d-b56b7010736e" released by "_delete_snapshot" :: held 4.930s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-5c414689-d3c1-46eb-a483-a3bd32277936" released by "delete_snapshot" :: held 4.990s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:00 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Created reservations ['9b1c162a-24f2-4011-9e5b-9bcbd44d1cf1', 'ae9b214c-2c76-4446-ae1d-d8e4394dfb98', '248a32d1-91d2-4963-bfb8-776b348e2312', '75416746-8515-484d-8861-2ae2e61651ee'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:01 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Delete snapshot completed successfully. Sep 23 00:26:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-e12547a4-9a10-451d-905d-b56b7010736e-delete_snapshot" released by "delete_snapshot" :: held 5.764s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Snapshots deleted, issuing volume delete {{(pid=86481) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 00:26:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-quobyte-5c414689-d3c1-46eb-a483-a3bd32277936" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-5c414689-d3c1-46eb-a483-a3bd32277936" acquired by "delete_volume" :: waited 0.081s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:01 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[39576826-4227-442f-a322-02cea85351b7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:02 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 Sep 23 00:26:02 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:04 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936" returned: 0 in 2.343s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:04 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936 Sep 23 00:26:04 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:04 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5c414689-d3c1-46eb-a483-a3bd32277936" returned: 0 in 0.803s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-5c414689-d3c1-46eb-a483-a3bd32277936" released by "delete_volume" :: held 3.521s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:05 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Created reservations ['085eade8-0fad-4fa7-b2ed-cca4291c2d87', '8f4f2fb0-9fda-4172-bfb7-7c1488ae9c8f', '966f1f41-64bd-479c-b688-67f24127ba36', 'a06c07e4-9f98-492b-b44b-d3c95fb313e1'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:05 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:26:05 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:06 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 1.184s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:06 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:06 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Deleted volume successfully. Sep 23 00:26:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e350303-8db7-47f2-8449-6a38264f64e0 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-5c414689-d3c1-46eb-a483-a3bd32277936-delete_volume" released by "delete_volume" :: held 17.910s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Flow 'volume_create_manager' (a7ae3455-7fca-4b7e-b159-a5bd84fd0179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dade5e4-0456-4e97-a0c7-98008a01b6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=106,cinder:SELECT=115,cinder:DELETE=7,cinder:INSERT=30 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dade5e4-0456-4e97-a0c7-98008a01b6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1982313269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ea9872-91aa-40c6-9d0c-c69442beb4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ccd988fd1b4735b527b780ed9e2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:09Z,use_quota=True,user_id='97922e05323f4eb388c454560903a2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c00a06d-7eda-4dba-9e7f-4e517600d20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c00a06d-7eda-4dba-9e7f-4e517600d20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7667076f-f335-4afd-a903-1b2e9bae5c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7667076f-f335-4afd-a903-1b2e9bae5c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ea9872-91aa-40c6-9d0c-c69442beb4f8', 'volume_name': 'volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aeead76-c3a7-422f-aad6-723b5d9a094d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aeead76-c3a7-422f-aad6-723b5d9a094d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4feb0952-a87c-4297-9593-faa3a270368c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:09 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Volume b6ea9872-91aa-40c6-9d0c-c69442beb4f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8', 'volume_size': 1} Sep 23 00:26:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Flow 'volume_create_manager' (0593646a-7d99-4210-b4cb-e7b93a6d2cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6f6eca-3c1d-4d5f-a80c-efa6234a5cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6f6eca-3c1d-4d5f-a80c-efa6234a5cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849991794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1946fec-4a73-4a72-953b-a6c8e623871b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855061c4b7884b3d95940fcf1808ae32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:10Z,use_quota=True,user_id='0de6cdf144bb4e2986198f17acb388d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c33f61-2f8a-46e3-9b2b-1dfba992d197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c33f61-2f8a-46e3-9b2b-1dfba992d197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021c4887-4580-40e8-bf69-991d4156cd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021c4887-4580-40e8-bf69-991d4156cd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1946fec-4a73-4a72-953b-a6c8e623871b', 'volume_name': 'volume-d1946fec-4a73-4a72-953b-a6c8e623871b', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fcacfc-9acc-4bff-8191-e54a0bf3ad56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fcacfc-9acc-4bff-8191-e54a0bf3ad56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03026983-5a02-4add-bc6a-bbd1ae43bb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:10 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Volume d1946fec-4a73-4a72-953b-a6c8e623871b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1946fec-4a73-4a72-953b-a6c8e623871b', 'volume_size': 1} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:10 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2" returned: 0 in 14.054s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d, size 1024.00 MB, duration 14.06 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:26:10 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Converted 1024.00 MB image at 72.86 MB/s Sep 23 00:26:10 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2 is being set with open permissions: ugo+rw Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:10 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2 Sep 23 00:26:10 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:10 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2" returned: 0 in 0.382s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-975d2195-55b4-4859-882b-d6743bdce3f2" released by "_copy_volume_from_snapshot" :: held 16.203s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-ad8dd7a2-1ce2-4d8b-81bc-804789937a82-975d2195-55b4-4859-882b-d6743bdce3f2" released by "_create_volume_from_snapshot" :: held 16.329s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.371s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1982313269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ea9872-91aa-40c6-9d0c-c69442beb4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ccd988fd1b4735b527b780ed9e2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:09Z,use_quota=True,user_id='97922e05323f4eb388c454560903a2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Creating volume b6ea9872-91aa-40c6-9d0c-c69442beb4f8 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:11 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:11 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 1073741824 Sep 23 00:26:11 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409915bd-c43a-4b9d-8238-aa950112dfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-975d2195-55b4-4859-882b-d6743bdce3f2', 'volume_size': 2, 'snapshot_id': 'ad8dd7a2-1ce2-4d8b-81bc-804789937a82'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a75232-6373-4d34-8cb6-d3d1e7d3fa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Volume volume-975d2195-55b4-4859-882b-d6743bdce3f2 (975d2195-55b4-4859-882b-d6743bdce3f2): created successfully Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a75232-6373-4d34-8cb6-d3d1e7d3fa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Flow 'volume_create_manager' (67728059-40cb-4290-af6d-d2ade1da50bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:11 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6a8f725a-7da5-4ccd-acb5-498914b4e5c7 tempest-VolumesSnapshotTestJSON-1382101784 None] Created volume successfully. Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-975d2195-55b4-4859-882b-d6743bdce3f2-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-975d2195-55b4-4859-882b-d6743bdce3f2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-975d2195-55b4-4859-882b-d6743bdce3f2" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-975d2195-55b4-4859-882b-d6743bdce3f2" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc7571b-165c-47a0-b966-23846749cc85]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:11 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 1073741824" returned: 0 in 0.689s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:11 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2 Sep 23 00:26:11 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:11 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 Sep 23 00:26:11 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:12 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8" returned: 0 in 0.279s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.629s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849991794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1946fec-4a73-4a72-953b-a6c8e623871b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855061c4b7884b3d95940fcf1808ae32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:10Z,use_quota=True,user_id='0de6cdf144bb4e2986198f17acb388d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Creating volume d1946fec-4a73-4a72-953b-a6c8e623871b {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:12 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d1946fec-4a73-4a72-953b-a6c8e623871b 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:12 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d1946fec-4a73-4a72-953b-a6c8e623871b 1073741824 Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4feb0952-a87c-4297-9593-faa3a270368c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:12 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:12 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6add85c-5428-4fd0-9e2b-d1defc7d5727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2" returned: 0 in 0.474s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:12 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Volume volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 (b6ea9872-91aa-40c6-9d0c-c69442beb4f8): created successfully Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6add85c-5428-4fd0-9e2b-d1defc7d5727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Flow 'volume_create_manager' (a7ae3455-7fca-4b7e-b159-a5bd84fd0179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:12 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2 Sep 23 00:26:12 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:12 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f05bf332-97c6-47a1-90de-cf3f8735ab0e tempest-VolumesDeleteCascade-605394640 None] Created volume successfully. Sep 23 00:26:12 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-975d2195-55b4-4859-882b-d6743bdce3f2" returned: 0 in 0.545s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-975d2195-55b4-4859-882b-d6743bdce3f2" released by "delete_volume" :: held 1.102s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:12 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Created reservations ['1e8f28f8-324b-429b-b165-6677b681d407', '2116ba6e-6120-4457-bb8f-539fb08c60c0', 'fb74ff11-c406-4296-89b8-a30a88b40fdc', 'c53f3ecc-ef70-46c0-beba-081dd93d0dbe'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d1946fec-4a73-4a72-953b-a6c8e623871b 1073741824" returned: 0 in 0.827s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d1946fec-4a73-4a72-953b-a6c8e623871b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:13 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d1946fec-4a73-4a72-953b-a6c8e623871b Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:13 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:13 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:26:13 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:13 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d1946fec-4a73-4a72-953b-a6c8e623871b" returned: 0 in 0.405s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.281s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03026983-5a02-4add-bc6a-bbd1ae43bb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1946fec-4a73-4a72-953b-a6c8e623871b', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4ce06e-3ab6-42ef-8a39-0356ce38a2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] Creating offline snapshot 6d46640d-3a83-4463-81f7-c470a8e4a3f0 of volume b6ea9872-91aa-40c6-9d0c-c69442beb4f8 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:13 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:13 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Volume volume-d1946fec-4a73-4a72-953b-a6c8e623871b (d1946fec-4a73-4a72-953b-a6c8e623871b): created successfully Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4ce06e-3ab6-42ef-8a39-0356ce38a2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Flow 'volume_create_manager' (0593646a-7d99-4210-b4cb-e7b93a6d2cd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27afde7-d59d-4bfd-a15a-2d6105ab896b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.391s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:13 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Deleted volume successfully. Sep 23 00:26:13 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2fb16482-822e-4d32-adeb-a850e9db57ae tempest-ProjectReaderTests-1023115479 None] Created volume successfully. Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-aac1b00e-3749-4580-ab43-14342aa63335 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-975d2195-55b4-4859-882b-d6743bdce3f2-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:13 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 Sep 23 00:26:13 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-ad8dd7a2-1ce2-4d8b-81bc-804789937a82-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-ad8dd7a2-1ce2-4d8b-81bc-804789937a82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-f13a119e-1894-489a-97b4-ef6dc4c22e9d" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-f13a119e-1894-489a-97b4-ef6dc4c22e9d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-ad8dd7a2-1ce2-4d8b-81bc-804789937a82" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-ad8dd7a2-1ce2-4d8b-81bc-804789937a82" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Deleting offline snapshot ad8dd7a2-1ce2-4d8b-81bc-804789937a82 of volume f13a119e-1894-489a-97b4-ef6dc4c22e9d {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] snapshot_file for this snap is: volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[768ce280-1343-4ff0-999c-cf3f0b047017]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:14 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8" returned: 0 in 0.564s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:14 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 1G Sep 23 00:26:14 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:14 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 Sep 23 00:26:14 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Acquiring lock "cinder-d1946fec-4a73-4a72-953b-a6c8e623871b-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Lock "cinder-d1946fec-4a73-4a72-953b-a6c8e623871b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Acquiring lock "cinder-quobyte-d1946fec-4a73-4a72-953b-a6c8e623871b" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Lock "cinder-quobyte-d1946fec-4a73-4a72-953b-a6c8e623871b" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f46749-94eb-4b00-9721-273fceeec3d1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d1946fec-4a73-4a72-953b-a6c8e623871b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:14 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 1G" returned: 0 in 0.601s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:14 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d1946fec-4a73-4a72-953b-a6c8e623871b Sep 23 00:26:14 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:14 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 Sep 23 00:26:14 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:14 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82" returned: 0 in 0.747s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f8bc32-9be3-458b-b1a4-f1789be228cf]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:15 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d Sep 23 00:26:15 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:15 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d1946fec-4a73-4a72-953b-a6c8e623871b" returned: 0 in 0.559s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d1946fec-4a73-4a72-953b-a6c8e623871b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:15 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d1946fec-4a73-4a72-953b-a6c8e623871b Sep 23 00:26:15 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:15 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0" returned: 0 in 0.522s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:15 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 is being set with open permissions: ugo+rw Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:15 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 Sep 23 00:26:15 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:15 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d1946fec-4a73-4a72-953b-a6c8e623871b" returned: 0 in 0.328s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Lock "cinder-quobyte-d1946fec-4a73-4a72-953b-a6c8e623871b" released by "delete_volume" :: held 0.972s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:15 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Created reservations ['6410c615-3b1d-41e5-8029-72024cd7d049', '76bf4eec-aaab-4018-8564-24a2a6bbe419', 'ba9d661b-a8d5-4cd1-a762-7c58ff59cf21', '717f2381-2e86-4f83-b2a1-6e263ec572ae'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d" returned: 0 in 0.730s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:15 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0" returned: 0 in 0.402s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:15 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 Sep 23 00:26:15 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:15 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.info Sep 23 00:26:15 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:15 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:26:15 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:16 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.info" returned: 0 in 0.346s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:16 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.info is being set with open permissions: ugo+rw Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:16 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.info Sep 23 00:26:16 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:16 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82" returned: 0 in 0.531s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:16 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82 Sep 23 00:26:16 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:16 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.379s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Deleted volume successfully. Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4321f354-a2ad-429e-af10-5256459af763 tempest-ProjectReaderTests-1023115479 None] Lock "cinder-d1946fec-4a73-4a72-953b-a6c8e623871b-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:16 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:16 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.info" returned: 0 in 0.382s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d.ad8dd7a2-1ce2-4d8b-81bc-804789937a82" returned: 0 in 0.368s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7ceff6f3-f3bc-4a84-ab59-57bb1da9e47a tempest-VolumesDeleteCascade-605394640 None] Create snapshot completed successfully Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-ad8dd7a2-1ce2-4d8b-81bc-804789937a82" released by "_delete_snapshot" :: held 2.560s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-f13a119e-1894-489a-97b4-ef6dc4c22e9d" released by "delete_snapshot" :: held 2.614s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Created reservations ['4db42fd3-bfba-4a2b-a3d5-649f3d833f8a', 'fc0c713a-beaa-4ef5-b634-6bc38668207a', 'b838f787-3321-4ab2-92cc-b9f25a20a05a', '523477ff-af57-4225-a492-8356d8ae6b53'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Delete snapshot completed successfully. Sep 23 00:26:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cd03996c-6b7d-44f3-b18a-88ea179c8056 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-ad8dd7a2-1ce2-4d8b-81bc-804789937a82-delete_snapshot" released by "delete_snapshot" :: held 2.870s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-f13a119e-1894-489a-97b4-ef6dc4c22e9d-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-f13a119e-1894-489a-97b4-ef6dc4c22e9d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-f13a119e-1894-489a-97b4-ef6dc4c22e9d" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-f13a119e-1894-489a-97b4-ef6dc4c22e9d" acquired by "delete_volume" :: waited 0.052s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[40488282-2c2b-47f9-a905-09e0378549fd]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Flow 'volume_create_manager' (6f0b22af-5637-48b9-b9fd-b08b87fd51be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fca713-b61c-40ec-9252-35e7e96dd271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fca713-b61c-40ec-9252-35e7e96dd271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437943786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a0f607-02fc-4100-9d40-d6c71fd1d2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855061c4b7884b3d95940fcf1808ae32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:18Z,use_quota=True,user_id='0de6cdf144bb4e2986198f17acb388d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee8ef34-db63-4c50-b598-e9d4ded563b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee8ef34-db63-4c50-b598-e9d4ded563b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f41aef3-4eef-453b-84a9-45bb2d03d7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f41aef3-4eef-453b-84a9-45bb2d03d7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a0f607-02fc-4100-9d40-d6c71fd1d2a0', 'volume_name': 'volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c6e9ad-0637-4051-8464-58bf7fd8085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c6e9ad-0637-4051-8464-58bf7fd8085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772ce200-eae6-4bab-8aa2-f8fb596f0390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:17 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Volume 82a0f607-02fc-4100-9d40-d6c71fd1d2a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0', 'volume_size': 1} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1437943786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a0f607-02fc-4100-9d40-d6c71fd1d2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855061c4b7884b3d95940fcf1808ae32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:18Z,use_quota=True,user_id='0de6cdf144bb4e2986198f17acb388d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Creating volume 82a0f607-02fc-4100-9d40-d6c71fd1d2a0 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:17 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:26:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:17 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0 1073741824 Sep 23 00:26:17 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:17 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d Sep 23 00:26:17 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:18 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d" returned: 0 in 0.682s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:18 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d Sep 23 00:26:18 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Flow 'volume_create_manager' (8d8d077a-c51c-4018-b6cc-916da4b28bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c7158e-47eb-4aa1-ac76-3db1548d1574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c7158e-47eb-4aa1-ac76-3db1548d1574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1367110168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308de990-254c-4017-b7b2-c513ca447d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13ccd988fd1b4735b527b780ed9e2579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d46640d-3a83-4463-81f7-c470a8e4a3f0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:18Z,use_quota=True,user_id='97922e05323f4eb388c454560903a2c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3f1dd8-a455-40a4-ae5b-872ff93f13c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3f1dd8-a455-40a4-ae5b-872ff93f13c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a92f912-9158-4a70-bf75-3e2c0396a841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a92f912-9158-4a70-bf75-3e2c0396a841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '308de990-254c-4017-b7b2-c513ca447d59', 'volume_name': 'volume-308de990-254c-4017-b7b2-c513ca447d59', 'volume_size': 1, 'snapshot_id': '6d46640d-3a83-4463-81f7-c470a8e4a3f0'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:18 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c3e194-21fe-4856-96ed-d42a7f180667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c3e194-21fe-4856-96ed-d42a7f180667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89af56f5-ae98-4aae-b106-29c774db8f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:18 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Volume 308de990-254c-4017-b7b2-c513ca447d59: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-308de990-254c-4017-b7b2-c513ca447d59', 'volume_size': 1, 'snapshot_id': '6d46640d-3a83-4463-81f7-c470a8e4a3f0'} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0 1073741824" returned: 0 in 0.907s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:18 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f13a119e-1894-489a-97b4-ef6dc4c22e9d" returned: 0 in 0.425s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-f13a119e-1894-489a-97b4-ef6dc4c22e9d" released by "delete_volume" :: held 1.242s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:18 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0 Sep 23 00:26:18 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Created reservations ['2a84de5c-5365-4e9e-b711-ec2cadeeec2f', 'ba45a72d-eb1e-44d1-a8a1-c0b8f7f9b107', 'de4064be-dc14-4741-891f-2466df9ce3b9', '1f443868-3c51-457b-aa1a-814d1b9981fc'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:18 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:26:18 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:19 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0" returned: 0 in 0.308s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.381s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-quobyte-6d46640d-3a83-4463-81f7-c470a8e4a3f0-308de990-254c-4017-b7b2-c513ca447d59" by "_create_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772ce200-eae6-4bab-8aa2-f8fb596f0390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba4b6d1-d935-4af0-a93a-7f6ac7dd05ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-6d46640d-3a83-4463-81f7-c470a8e4a3f0-308de990-254c-4017-b7b2-c513ca447d59" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Creating volume 308de990-254c-4017-b7b2-c513ca447d59 from snapshot 6d46640d-3a83-4463-81f7-c470a8e4a3f0 {{(pid=86481) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-quobyte-308de990-254c-4017-b7b2-c513ca447d59" by "_copy_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:19 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Volume volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0 (82a0f607-02fc-4100-9d40-d6c71fd1d2a0): created successfully Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba4b6d1-d935-4af0-a93a-7f6ac7dd05ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Flow 'volume_create_manager' (6f0b22af-5637-48b9-b9fd-b08b87fd51be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-308de990-254c-4017-b7b2-c513ca447d59" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] snapshot: 6d46640d-3a83-4463-81f7-c470a8e4a3f0, volume: 308de990-254c-4017-b7b2-c513ca447d59, {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:26:19 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-bb0eb4a1-a0d9-4db9-9ebb-4a18c1ee60e0 tempest-ProjectReaderTests-1023115479 None] Created volume successfully. Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd6adea-6679-46a2-87e8-c24d077afe2e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:19 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.338s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:19 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Deleted volume successfully. Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4718ebd0-49b4-433a-a55a-995c4fd90072 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-f13a119e-1894-489a-97b4-ef6dc4c22e9d-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:19 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 Sep 23 00:26:19 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:19 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0" returned: 0 in 0.516s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Acquiring lock "cinder-82a0f607-02fc-4100-9d40-d6c71fd1d2a0-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6f52b3-5991-48cf-89c3-2697b339f56e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Lock "cinder-82a0f607-02fc-4100-9d40-d6c71fd1d2a0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Acquiring lock "cinder-quobyte-82a0f607-02fc-4100-9d40-d6c71fd1d2a0" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Lock "cinder-quobyte-82a0f607-02fc-4100-9d40-d6c71fd1d2a0" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a6a095-82cf-4acb-96db-8cd9c4598ffe]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:19 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 Sep 23 00:26:19 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:20 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0 Sep 23 00:26:20 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:20 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8" returned: 0 in 0.550s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Creating direct copy from snapshot {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.utils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Path /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59 not found in is_blk_device check {{(pid=86481) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:20 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59 Sep 23 00:26:20 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:20 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Flow 'volume_create_manager' (4ae07aa4-fa12-47e6-9c39-74dd4697a2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cf2436-cf35-4f68-bcc5-6f6ea10f20ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0" returned: 0 in 0.593s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:20 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0 Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cf2436-cf35-4f68-bcc5-6f6ea10f20ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1950668874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7b84da-ee53-4954-9a16-6aec426d7344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74aeb64943d647e1a4fd8ba3741503a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:20Z,use_quota=True,user_id='95f81612f31a4d1b9de49e3f2044f667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:20 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3c70a6-31a4-409f-8843-e92bd0867caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3c70a6-31a4-409f-8843-e92bd0867caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9ac64e-ff9e-49eb-be9c-cd989a690b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9ac64e-ff9e-49eb-be9c-cd989a690b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7b84da-ee53-4954-9a16-6aec426d7344', 'volume_name': 'volume-2a7b84da-ee53-4954-9a16-6aec426d7344', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571c5bf7-272c-49c9-ba7f-137dff1b80c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571c5bf7-272c-49c9-ba7f-137dff1b80c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71b1e0d-1dcf-48ca-b3ea-512bd2209cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:20 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Volume 2a7b84da-ee53-4954-9a16-6aec426d7344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7b84da-ee53-4954-9a16-6aec426d7344', 'volume_size': 1} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:20 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-82a0f607-02fc-4100-9d40-d6c71fd1d2a0" returned: 0 in 0.329s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Lock "cinder-quobyte-82a0f607-02fc-4100-9d40-d6c71fd1d2a0" released by "delete_volume" :: held 0.978s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:20 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Created reservations ['b21c4c75-1130-447c-9935-aeb38c589f94', '9080eeee-71c0-4545-9299-d9548997d123', '44981035-e3ec-474e-aa70-bf8c4c9ceab3', '52495b6f-b4da-46d9-9a70-fce9e734a457'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:21 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:26:21 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:21 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.433s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:21 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:21 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Deleted volume successfully. Sep 23 00:26:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d522f9f1-53c1-4475-9fa7-5dd2fb39a1ed tempest-ProjectReaderTests-1023115479 None] Lock "cinder-82a0f607-02fc-4100-9d40-d6c71fd1d2a0-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:23 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Flow 'volume_create_manager' (35ace267-5bc6-4044-a5a8-883dfbc4788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcef769f-4d8c-498a-8ee3-9029bac254e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcef769f-4d8c-498a-8ee3-9029bac254e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190118946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c7d109-dadd-4280-a336-8552375660c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855061c4b7884b3d95940fcf1808ae32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:23Z,use_quota=True,user_id='0de6cdf144bb4e2986198f17acb388d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a89d7ee-5868-43c2-95c9-ae07735b0cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a89d7ee-5868-43c2-95c9-ae07735b0cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7cc530-85b2-4ec5-91be-7fccc0cf530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7cc530-85b2-4ec5-91be-7fccc0cf530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c7d109-dadd-4280-a336-8552375660c0', 'volume_name': 'volume-41c7d109-dadd-4280-a336-8552375660c0', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f13d75-2db2-4a11-9f53-1d9f27267525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f13d75-2db2-4a11-9f53-1d9f27267525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9b8edd-34c4-49d0-9b6a-6985404be082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:23 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Volume 41c7d109-dadd-4280-a336-8552375660c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c7d109-dadd-4280-a336-8552375660c0', 'volume_size': 1} Sep 23 00:26:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:28 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59" returned: 0 in 8.197s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8, size 1024.00 MB, duration 8.20 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:26:28 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Converted 1024.00 MB image at 124.91 MB/s Sep 23 00:26:28 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59 is being set with open permissions: ugo+rw Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:28 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59 Sep 23 00:26:28 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:28 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59" returned: 0 in 0.303s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-308de990-254c-4017-b7b2-c513ca447d59" released by "_copy_volume_from_snapshot" :: held 9.721s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-6d46640d-3a83-4463-81f7-c470a8e4a3f0-308de990-254c-4017-b7b2-c513ca447d59" released by "_create_volume_from_snapshot" :: held 9.831s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.866s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.332s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1950668874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7b84da-ee53-4954-9a16-6aec426d7344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74aeb64943d647e1a4fd8ba3741503a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:20Z,use_quota=True,user_id='95f81612f31a4d1b9de49e3f2044f667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Creating volume 2a7b84da-ee53-4954-9a16-6aec426d7344 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:28 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:28 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 1073741824 Sep 23 00:26:28 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89af56f5-ae98-4aae-b106-29c774db8f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308de990-254c-4017-b7b2-c513ca447d59', 'volume_size': 1, 'snapshot_id': '6d46640d-3a83-4463-81f7-c470a8e4a3f0'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9c1a8f-e94d-4c9f-b792-8cfa1111ee96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:29 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Volume volume-308de990-254c-4017-b7b2-c513ca447d59 (308de990-254c-4017-b7b2-c513ca447d59): created successfully Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9c1a8f-e94d-4c9f-b792-8cfa1111ee96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Flow 'volume_create_manager' (8d8d077a-c51c-4018-b6cc-916da4b28bc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:29 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b1b18c8a-2284-4c5f-9846-7288549188db tempest-VolumesDeleteCascade-605394640 None] Created volume successfully. Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-b6ea9872-91aa-40c6-9d0c-c69442beb4f8-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-b6ea9872-91aa-40c6-9d0c-c69442beb4f8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:29 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 1073741824" returned: 0 in 0.799s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Performing cascade delete. {{(pid=86481) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-6d46640d-3a83-4463-81f7-c470a8e4a3f0-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:29 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 Sep 23 00:26:29 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-6d46640d-3a83-4463-81f7-c470a8e4a3f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-quobyte-b6ea9872-91aa-40c6-9d0c-c69442beb4f8" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-b6ea9872-91aa-40c6-9d0c-c69442beb4f8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-quobyte-6d46640d-3a83-4463-81f7-c470a8e4a3f0" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-6d46640d-3a83-4463-81f7-c470a8e4a3f0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Deleting offline snapshot 6d46640d-3a83-4463-81f7-c470a8e4a3f0 of volume b6ea9872-91aa-40c6-9d0c-c69442beb4f8 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] snapshot_file for this snap is: volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b998ddc3-4c82-429f-85ca-5deb12514439]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:30 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 Sep 23 00:26:30 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:30 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344" returned: 0 in 0.357s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.533s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190118946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c7d109-dadd-4280-a336-8552375660c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855061c4b7884b3d95940fcf1808ae32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:23Z,use_quota=True,user_id='0de6cdf144bb4e2986198f17acb388d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Creating volume 41c7d109-dadd-4280-a336-8552375660c0 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:30 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-41c7d109-dadd-4280-a336-8552375660c0 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71b1e0d-1dcf-48ca-b3ea-512bd2209cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7b84da-ee53-4954-9a16-6aec426d7344', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afb1829-6240-4d06-8318-b617a32d0d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:30 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-41c7d109-dadd-4280-a336-8552375660c0 1073741824 Sep 23 00:26:30 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:30 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Volume volume-2a7b84da-ee53-4954-9a16-6aec426d7344 (2a7b84da-ee53-4954-9a16-6aec426d7344): created successfully Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afb1829-6240-4d06-8318-b617a32d0d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Flow 'volume_create_manager' (4ae07aa4-fa12-47e6-9c39-74dd4697a2e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:30 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-93cb57c0-2ecf-408f-98bf-b4a562baf095 tempest-VolumesSnapshotTestJSON-1382101784 None] Created volume successfully. Sep 23 00:26:30 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0" returned: 0 in 0.529s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a6cc59-6994-45cd-b8db-76918e9f297e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:30 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 Sep 23 00:26:30 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:30 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-41c7d109-dadd-4280-a336-8552375660c0 1073741824" returned: 0 in 0.804s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-41c7d109-dadd-4280-a336-8552375660c0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:31 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-41c7d109-dadd-4280-a336-8552375660c0 Sep 23 00:26:31 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:31 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-41c7d109-dadd-4280-a336-8552375660c0" returned: 0 in 0.315s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.570s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] Creating offline snapshot ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 of volume 2a7b84da-ee53-4954-9a16-6aec426d7344 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9b8edd-34c4-49d0-9b6a-6985404be082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c7d109-dadd-4280-a336-8552375660c0', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0517eab9-9a21-4dfc-a051-b22a839a639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9261033f-8559-4606-93cb-925f5c52ed1a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:31 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8" returned: 0 in 0.906s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:31 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Volume volume-41c7d109-dadd-4280-a336-8552375660c0 (41c7d109-dadd-4280-a336-8552375660c0): created successfully Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0517eab9-9a21-4dfc-a051-b22a839a639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Flow 'volume_create_manager' (35ace267-5bc6-4044-a5a8-883dfbc4788a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:31 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 Sep 23 00:26:31 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:31 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4ca303d0-7c2f-4125-b81e-2f2873002427 tempest-ProjectReaderTests-1023115479 None] Created volume successfully. Sep 23 00:26:31 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 Sep 23 00:26:31 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:31 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0" returned: 0 in 0.557s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:31 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344" returned: 0 in 0.606s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:32 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0 Sep 23 00:26:32 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:32 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 1G Sep 23 00:26:32 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Acquiring lock "cinder-41c7d109-dadd-4280-a336-8552375660c0-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:32 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8.6d46640d-3a83-4463-81f7-c470a8e4a3f0" returned: 0 in 0.632s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Lock "cinder-41c7d109-dadd-4280-a336-8552375660c0-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-6d46640d-3a83-4463-81f7-c470a8e4a3f0" released by "_delete_snapshot" :: held 2.813s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-b6ea9872-91aa-40c6-9d0c-c69442beb4f8" released by "delete_snapshot" :: held 2.848s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Acquiring lock "cinder-quobyte-41c7d109-dadd-4280-a336-8552375660c0" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Lock "cinder-quobyte-41c7d109-dadd-4280-a336-8552375660c0" acquired by "delete_volume" :: waited 0.045s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:32 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a3af76-7470-4497-a555-228fad7a53ec]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-41c7d109-dadd-4280-a336-8552375660c0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:32 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Created reservations ['2504bf85-6f1b-4682-8298-e37c2f3c5a0b', 'e2392d79-ac84-4487-9831-5869f1f46859', '1291022a-89ec-4912-9f18-a35e9687af86', '0e6d1b95-0c79-4d82-9aa6-8d29c8ce9644'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:33 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:33 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Delete snapshot completed successfully. Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 1G" returned: 0 in 1.021s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7b84da-ee53-4954-9a16-6aec426d7344 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-6d46640d-3a83-4463-81f7-c470a8e4a3f0-delete_snapshot" released by "delete_snapshot" :: held 3.223s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Snapshots deleted, issuing volume delete {{(pid=86481) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-quobyte-b6ea9872-91aa-40c6-9d0c-c69442beb4f8" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:33 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-a69db50b-7924-4961-a63b-6d8fe29e4626 req-f5419b35-90c5-43d5-9f31-d3df9ec94f6d tempest-TestShelveInstance-7289932 None] Terminate volume connection completed successfully. Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-a69db50b-7924-4961-a63b-6d8fe29e4626 req-f5419b35-90c5-43d5-9f31-d3df9ec94f6d tempest-TestShelveInstance-7289932 None] Deleting attachment 303e9dc3-2dde-4375-99c6-966d95feae23. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:26:33 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-41c7d109-dadd-4280-a336-8552375660c0 Sep 23 00:26:33 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-b6ea9872-91aa-40c6-9d0c-c69442beb4f8" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:33 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7b84da-ee53-4954-9a16-6aec426d7344 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 Sep 23 00:26:33 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be7ceda-5ada-483e-abb7-6dbe2c3dca70]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:33 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 Sep 23 00:26:33 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:33 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-41c7d109-dadd-4280-a336-8552375660c0" returned: 0 in 0.699s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-41c7d109-dadd-4280-a336-8552375660c0 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:33 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-41c7d109-dadd-4280-a336-8552375660c0 Sep 23 00:26:33 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:33 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7b84da-ee53-4954-9a16-6aec426d7344 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2" returned: 0 in 0.594s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:33 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 is being set with open permissions: ugo+rw Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:33 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 Sep 23 00:26:33 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:33 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8" returned: 0 in 0.688s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:33 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8 Sep 23 00:26:33 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:34 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-41c7d109-dadd-4280-a336-8552375660c0" returned: 0 in 0.484s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Lock "cinder-quobyte-41c7d109-dadd-4280-a336-8552375660c0" released by "delete_volume" :: held 1.258s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Created reservations ['72d5b2ce-bfdd-4963-9013-de7c878a6782', '811485b3-8866-4477-9327-a5cff915de1e', 'd6c46c03-bc9d-422a-88b7-b16b569b8232', '2f6de110-1431-4483-a16b-acaf9555d546'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:34 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2" returned: 0 in 0.604s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:34 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:26:34 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:34 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6ea9872-91aa-40c6-9d0c-c69442beb4f8" returned: 0 in 0.453s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-b6ea9872-91aa-40c6-9d0c-c69442beb4f8" released by "delete_volume" :: held 1.284s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:34 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.info Sep 23 00:26:34 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Created reservations ['f358f797-8d84-449f-90f9-704e1f0dbaba', 'ebcfa5ec-d71c-4706-a929-f087a7c5af5c', 'd9e0df35-b010-4392-9229-86aa0273ebfa', '535c8dbb-39a1-4ff5-99f8-a0c2a1bb0b43'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:34 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:26:34 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:34 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.538s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:34 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.info" returned: 0 in 0.488s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:34 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.info is being set with open permissions: ugo+rw Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:34 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Deleted volume successfully. Sep 23 00:26:34 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.info Sep 23 00:26:34 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8a015eeb-e160-4c8f-8bb7-ed750c4f4097 tempest-ProjectReaderTests-1023115479 None] Lock "cinder-41c7d109-dadd-4280-a336-8552375660c0-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:35 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.576s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:35 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Deleted volume successfully. Sep 23 00:26:35 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.info" returned: 0 in 0.408s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.929s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-73fccb16-4f55-40bf-917d-8804f5244090 tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-b6ea9872-91aa-40c6-9d0c-c69442beb4f8-delete_volume" released by "delete_volume" :: held 5.562s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:35 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-70713f24-3891-4b31-9388-09afc4fedcf4 tempest-VolumesSnapshotTestJSON-1382101784 None] Create snapshot completed successfully Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-308de990-254c-4017-b7b2-c513ca447d59-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-308de990-254c-4017-b7b2-c513ca447d59-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "cinder-quobyte-308de990-254c-4017-b7b2-c513ca447d59" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-308de990-254c-4017-b7b2-c513ca447d59" acquired by "delete_volume" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8368d3a-cbe2-468b-884a-bc001051867e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Flow 'volume_create_manager' (4c6d789c-4cc7-4b1b-a189-dec6307a5c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c313c32-a193-4417-bc8a-921b26e80e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c313c32-a193-4417-bc8a-921b26e80e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526700886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beadf43a-576a-4fac-9d3e-6b40c058b776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855061c4b7884b3d95940fcf1808ae32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:36Z,use_quota=True,user_id='0de6cdf144bb4e2986198f17acb388d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7025d45-1cac-4c46-83af-058ebd6028a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7025d45-1cac-4c46-83af-058ebd6028a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1354d2c-f6e7-4f6e-9b37-a5bf592081b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1354d2c-f6e7-4f6e-9b37-a5bf592081b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beadf43a-576a-4fac-9d3e-6b40c058b776', 'volume_name': 'volume-beadf43a-576a-4fac-9d3e-6b40c058b776', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78390c6-4dde-4b93-b951-f0c476b4fcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78390c6-4dde-4b93-b951-f0c476b4fcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afe7352-f3fe-4732-a610-fba32733ca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:35 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Volume beadf43a-576a-4fac-9d3e-6b40c058b776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beadf43a-576a-4fac-9d3e-6b40c058b776', 'volume_size': 1} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526700886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beadf43a-576a-4fac-9d3e-6b40c058b776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855061c4b7884b3d95940fcf1808ae32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:36Z,use_quota=True,user_id='0de6cdf144bb4e2986198f17acb388d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Creating volume beadf43a-576a-4fac-9d3e-6b40c058b776 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:35 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59 Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:35 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:26:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-beadf43a-576a-4fac-9d3e-6b40c058b776 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:35 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:35 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-beadf43a-576a-4fac-9d3e-6b40c058b776 1073741824 Sep 23 00:26:35 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:36 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59" returned: 0 in 0.611s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:36 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59 Sep 23 00:26:36 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:36 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-beadf43a-576a-4fac-9d3e-6b40c058b776 1073741824" returned: 0 in 0.804s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-e07ba5bc-68bc-46aa-a643-340be975df82 req-594b0193-1c32-412a-a6ee-b58f6ab9b4ec tempest-TestShelveInstance-7289932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-beadf43a-576a-4fac-9d3e-6b40c058b776 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:36 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-308de990-254c-4017-b7b2-c513ca447d59" returned: 0 in 0.411s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:36 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-beadf43a-576a-4fac-9d3e-6b40c058b776 Sep 23 00:26:36 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-quobyte-308de990-254c-4017-b7b2-c513ca447d59" released by "delete_volume" :: held 1.090s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:36 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Created reservations ['23ac0da8-9143-475b-87d3-0ea0df416634', 'eb92e61e-a062-42b7-a9c5-4a7ef001a6fd', 'dba3e94f-8892-42d2-a574-1691d21baef9', 'ce0c5074-dcd6-454b-a866-74b61c3af1e9'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:37 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:26:37 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:37 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Flow 'volume_create_manager' (4e2672b7-c096-4532-b348-955d43923bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7405881-55da-42d8-82aa-dd75e788d92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-beadf43a-576a-4fac-9d3e-6b40c058b776" returned: 0 in 0.371s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-e07ba5bc-68bc-46aa-a643-340be975df82 req-594b0193-1c32-412a-a6ee-b58f6ab9b4ec tempest-TestShelveInstance-7289932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.416s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7405881-55da-42d8-82aa-dd75e788d92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1504416369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bc03f4-6b24-4a54-b43e-03a6e4f9510f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74aeb64943d647e1a4fd8ba3741503a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ed1e2bfe-7156-43e4-b639-c3d1b5248cc2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:37Z,use_quota=True,user_id='95f81612f31a4d1b9de49e3f2044f667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985f79fe-b1ea-4991-8161-8f6faaa39d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985f79fe-b1ea-4991-8161-8f6faaa39d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67db673d-d7c9-4952-86a2-792f88ceecea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67db673d-d7c9-4952-86a2-792f88ceecea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05bc03f4-6b24-4a54-b43e-03a6e4f9510f', 'volume_name': 'volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f', 'volume_size': 1, 'snapshot_id': 'ed1e2bfe-7156-43e4-b639-c3d1b5248cc2'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010c9bd7-7fe5-407f-963d-1fb90b68a417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010c9bd7-7fe5-407f-963d-1fb90b68a417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2dd699-a223-436e-8c50-330648a63973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Volume 05bc03f4-6b24-4a54-b43e-03a6e4f9510f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f', 'volume_size': 1, 'snapshot_id': 'ed1e2bfe-7156-43e4-b639-c3d1b5248cc2'} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afe7352-f3fe-4732-a610-fba32733ca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beadf43a-576a-4fac-9d3e-6b40c058b776', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7df5f0-51ba-405d-8776-7d09cde81816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-e07ba5bc-68bc-46aa-a643-340be975df82 req-594b0193-1c32-412a-a6ee-b58f6ab9b4ec tempest-TestShelveInstance-7289932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.082s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-ed1e2bfe-7156-43e4-b639-c3d1b5248cc2-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" by "_create_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:37 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Volume volume-beadf43a-576a-4fac-9d3e-6b40c058b776 (beadf43a-576a-4fac-9d3e-6b40c058b776): created successfully Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7df5f0-51ba-405d-8776-7d09cde81816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Flow 'volume_create_manager' (4c6d789c-4cc7-4b1b-a189-dec6307a5c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-ed1e2bfe-7156-43e4-b639-c3d1b5248cc2-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Creating volume 05bc03f4-6b24-4a54-b43e-03a6e4f9510f from snapshot ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 {{(pid=86481) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" by "_copy_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-710b6379-fa90-496d-8bc0-ef23ebda06b6 tempest-ProjectReaderTests-1023115479 None] Created volume successfully. Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] snapshot: ed1e2bfe-7156-43e4-b639-c3d1b5248cc2, volume: 05bc03f4-6b24-4a54-b43e-03a6e4f9510f, {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-e07ba5bc-68bc-46aa-a643-340be975df82 req-594b0193-1c32-412a-a6ee-b58f6ab9b4ec tempest-TestShelveInstance-7289932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-4c59233e-b655-4df5-9261-f9b121fba3dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '187d3265-a8f2-4610-8b4d-5b82b2d520f6', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:26:37 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.340s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc855dab-3302-4f3e-b628-f3f330dcd5fb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Deleted volume successfully. Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a9340617-9710-48b8-9986-2dbeb43be1bc tempest-VolumesDeleteCascade-605394640 None] Lock "cinder-308de990-254c-4017-b7b2-c513ca447d59-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-e07ba5bc-68bc-46aa-a643-340be975df82 req-594b0193-1c32-412a-a6ee-b58f6ab9b4ec tempest-TestShelveInstance-7289932 None] attachment_update completed successfully. Sep 23 00:26:37 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 Sep 23 00:26:37 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:37 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2" returned: 0 in 0.515s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a7b84da-ee53-4954-9a16-6aec426d7344(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5292982-1ba8-4d31-97e1-7f53e8fd040b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:38 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 Sep 23 00:26:38 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Acquiring lock "cinder-beadf43a-576a-4fac-9d3e-6b40c058b776-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Lock "cinder-beadf43a-576a-4fac-9d3e-6b40c058b776-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Acquiring lock "cinder-quobyte-beadf43a-576a-4fac-9d3e-6b40c058b776" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Lock "cinder-quobyte-beadf43a-576a-4fac-9d3e-6b40c058b776" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84d415a-94c3-4f95-a104-a86dca3de9cb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-beadf43a-576a-4fac-9d3e-6b40c058b776 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:38 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344" returned: 0 in 0.499s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Creating direct copy from snapshot {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG cinder.utils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Path /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f not found in is_blk_device check {{(pid=86481) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:38 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-beadf43a-576a-4fac-9d3e-6b40c058b776 Sep 23 00:26:38 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:38 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f Sep 23 00:26:38 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:38 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-beadf43a-576a-4fac-9d3e-6b40c058b776" returned: 0 in 0.512s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-beadf43a-576a-4fac-9d3e-6b40c058b776 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:38 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-beadf43a-576a-4fac-9d3e-6b40c058b776 Sep 23 00:26:38 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:39 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-beadf43a-576a-4fac-9d3e-6b40c058b776" returned: 0 in 0.634s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Lock "cinder-quobyte-beadf43a-576a-4fac-9d3e-6b40c058b776" released by "delete_volume" :: held 1.244s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:39 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Created reservations ['59ce210d-a443-4847-ad4e-bb626e1c9d9d', 'ec7fa4c4-3bad-4917-b9ef-eec7d20ed6c2', '73710e73-2e60-4f28-a1e2-1598dcfc9013', '04c837d1-c67e-4f65-a03a-41e19c7c52de'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:40 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:26:40 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:41 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.972s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:41 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:41 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Deleted volume successfully. Sep 23 00:26:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-07313218-a4f4-4f32-810c-ac3c0f055d5e tempest-ProjectReaderTests-1023115479 None] Lock "cinder-beadf43a-576a-4fac-9d3e-6b40c058b776-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:26:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:45 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:26:45 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:46 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 1.021s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:46 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:46 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:26:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:26:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:26:50 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=81,cinder:UPDATE=98,cinder:INSERT=30,cinder:DELETE=8 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:50 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" returned: 0 in 12.213s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:50 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344, size 1024.00 MB, duration 12.21 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:26:50 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Converted 1024.00 MB image at 83.84 MB/s Sep 23 00:26:50 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f is being set with open permissions: ugo+rw Sep 23 00:26:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:50 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f Sep 23 00:26:50 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=106,cinder:UPDATE=129,cinder:INSERT=27,cinder:DELETE=10 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:51 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" returned: 0 in 0.449s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" released by "_copy_volume_from_snapshot" :: held 13.790s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Flow 'volume_create_manager' (9d934d75-0169-49d3-af9c-536ba113cbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5961d61-7b3f-45cc-8306-a6d3564b0d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-ed1e2bfe-7156-43e4-b639-c3d1b5248cc2-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" released by "_create_volume_from_snapshot" :: held 13.944s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.988s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5961d61-7b3f-45cc-8306-a6d3564b0d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1187921826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e78bfe-6988-4bb5-9b2d-feb05672d112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ff23498f194384a2c2288c62e132c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:51Z,use_quota=True,user_id='6f3fd79281734b20b409c30684fa0799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9354bb4-f927-458c-97d9-60cc3861799e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9354bb4-f927-458c-97d9-60cc3861799e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eaa9b59-0ea7-448c-871c-f0ad4e274cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eaa9b59-0ea7-448c-871c-f0ad4e274cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e78bfe-6988-4bb5-9b2d-feb05672d112', 'volume_name': 'volume-63e78bfe-6988-4bb5-9b2d-feb05672d112', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9312250b-f840-47d5-863b-b80b14b574cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9312250b-f840-47d5-863b-b80b14b574cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d7802e-a8ea-4ced-8e1c-ab6aaa32c0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:51 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Volume 63e78bfe-6988-4bb5-9b2d-feb05672d112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e78bfe-6988-4bb5-9b2d-feb05672d112', 'volume_size': 1} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1187921826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e78bfe-6988-4bb5-9b2d-feb05672d112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ff23498f194384a2c2288c62e132c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:51Z,use_quota=True,user_id='6f3fd79281734b20b409c30684fa0799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Creating volume 63e78bfe-6988-4bb5-9b2d-feb05672d112 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:51 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2dd699-a223-436e-8c50-330648a63973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f', 'volume_size': 1, 'snapshot_id': 'ed1e2bfe-7156-43e4-b639-c3d1b5248cc2'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:51 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 1073741824 Sep 23 00:26:51 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b073ff0d-6a8b-4005-9cd3-ee744d764994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:51 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Volume volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f (05bc03f4-6b24-4a54-b43e-03a6e4f9510f): created successfully Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b073ff0d-6a8b-4005-9cd3-ee744d764994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Flow 'volume_create_manager' (4e2672b7-c096-4532-b348-955d43923bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:51 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-95f915b8-8b15-4c71-9f72-91e8f0fb139e tempest-VolumesSnapshotTestJSON-1382101784 None] Created volume successfully. Sep 23 00:26:51 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 1073741824" returned: 0 in 0.582s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:52 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 Sep 23 00:26:52 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-05bc03f4-6b24-4a54-b43e-03a6e4f9510f-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-05bc03f4-6b24-4a54-b43e-03a6e4f9510f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a7c91a-aea5-4f52-9fd9-db9a412a830f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:52 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f Sep 23 00:26:52 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:52 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112" returned: 0 in 0.427s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d7802e-a8ea-4ced-8e1c-ab6aaa32c0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e78bfe-6988-4bb5-9b2d-feb05672d112', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9443e9d3-4437-4e5f-9556-aabd3e2535f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:52 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Volume volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 (63e78bfe-6988-4bb5-9b2d-feb05672d112): created successfully Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9443e9d3-4437-4e5f-9556-aabd3e2535f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Flow 'volume_create_manager' (9d934d75-0169-49d3-af9c-536ba113cbfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:52 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5d3179a3-abc1-429b-ae40-f96e88545db5 tempest-VolumesCloneTest-1435288770 None] Created volume successfully. Sep 23 00:26:52 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" returned: 0 in 0.436s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:52 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f Sep 23 00:26:52 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:52 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" returned: 0 in 0.289s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-05bc03f4-6b24-4a54-b43e-03a6e4f9510f" released by "delete_volume" :: held 0.788s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:52 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Created reservations ['b6ea9574-de8c-4722-9754-8f7f86f423f8', 'a26fad6c-2e5f-42c0-a0d0-c9ecbd2d44fa', 'c4a68d28-80a6-4ea1-b6ca-6773d067e5d9', 'a3744c32-e63d-46e6-bc87-acc65acc30f7'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:53 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:26:53 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-ed1e2bfe-7156-43e4-b639-c3d1b5248cc2-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-ed1e2bfe-7156-43e4-b639-c3d1b5248cc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-2a7b84da-ee53-4954-9a16-6aec426d7344" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-2a7b84da-ee53-4954-9a16-6aec426d7344" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-ed1e2bfe-7156-43e4-b639-c3d1b5248cc2" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-ed1e2bfe-7156-43e4-b639-c3d1b5248cc2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:53 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Deleting offline snapshot ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 of volume 2a7b84da-ee53-4954-9a16-6aec426d7344 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] snapshot_file for this snap is: volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.413s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:53 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Deleted volume successfully. Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc8a911-afb2-48b1-917e-6408b93a04b6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cec6469d-01de-4df3-b459-25d2ec34059c tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-05bc03f4-6b24-4a54-b43e-03a6e4f9510f-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:53 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 Sep 23 00:26:53 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:54 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2" returned: 0 in 0.610s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a7b84da-ee53-4954-9a16-6aec426d7344(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[c555b786-020c-4d74-a8f5-c87f429e00da]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:54 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 Sep 23 00:26:54 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Flow 'volume_create_manager' (8f7355f9-e026-4e17-bb2a-7b507eb864f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73066fb4-1234-45fc-964e-74f9ef0f264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73066fb4-1234-45fc-964e-74f9ef0f264c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-79048038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3408c53-67a5-47c0-a0d4-0a2d04699a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ff23498f194384a2c2288c62e132c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=63e78bfe-6988-4bb5-9b2d-feb05672d112,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:54Z,use_quota=True,user_id='6f3fd79281734b20b409c30684fa0799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67180a39-d1eb-477c-9b02-7252184eca20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67180a39-d1eb-477c-9b02-7252184eca20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86579c71-7120-43e4-956e-fd66b1c7cc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86579c71-7120-43e4-956e-fd66b1c7cc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b3408c53-67a5-47c0-a0d4-0a2d04699a0a', 'volume_name': 'volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a', 'volume_size': 2, 'source_volid': '63e78bfe-6988-4bb5-9b2d-feb05672d112', 'source_volstatus': 'available'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182f27a4-2631-431d-8e4f-e23019d4c261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182f27a4-2631-431d-8e4f-e23019d4c261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df9eb93-65f0-437d-9158-c62b0ab6f4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:54 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Volume b3408c53-67a5-47c0-a0d4-0a2d04699a0a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a', 'volume_size': 2, 'source_volid': '63e78bfe-6988-4bb5-9b2d-feb05672d112', 'source_volstatus': 'available'} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:54 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Cloning volume 63e78bfe-6988-4bb5-9b2d-feb05672d112 to volume b3408c53-67a5-47c0-a0d4-0a2d04699a0a Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Creating offline snapshot 107a739b-b85f-4f05-b3a5-1b8c4b15fc31 of volume 63e78bfe-6988-4bb5-9b2d-feb05672d112 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39ba720-bf05-4065-a7f7-d713677e3bdc]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:54 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 Sep 23 00:26:54 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:54 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344" returned: 0 in 0.719s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:54 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 Sep 23 00:26:54 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:55 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112" returned: 0 in 0.496s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:55 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 1G Sep 23 00:26:55 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:55 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2" returned: 0 in 0.433s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:55 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2 Sep 23 00:26:55 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:55 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344.ed1e2bfe-7156-43e4-b639-c3d1b5248cc2" returned: 0 in 0.363s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 1G" returned: 0 in 0.589s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-ed1e2bfe-7156-43e4-b639-c3d1b5248cc2" released by "_delete_snapshot" :: held 2.306s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-2a7b84da-ee53-4954-9a16-6aec426d7344" released by "delete_snapshot" :: held 2.354s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:55 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 Sep 23 00:26:55 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:55 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Created reservations ['d9edaf4a-990b-4673-bd57-70f573634dca', '3d6762cd-dc4a-4a0f-8f90-979a6be408e0', '4ad27bb7-d8f6-4d55-8f8e-daa27e857a79', '8e9d8668-6674-464e-aa8e-1b2cd0fa0b27'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:55 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Delete snapshot completed successfully. Sep 23 00:26:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0fdb68e5-5cac-44d3-beae-a5fafb6bffda tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-ed1e2bfe-7156-43e4-b639-c3d1b5248cc2-delete_snapshot" released by "delete_snapshot" :: held 2.569s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:56 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31" returned: 0 in 0.366s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:56 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 is being set with open permissions: ugo+rw Sep 23 00:26:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:56 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 Sep 23 00:26:56 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:56 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31" returned: 0 in 0.302s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:56 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.info Sep 23 00:26:56 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-2a7b84da-ee53-4954-9a16-6aec426d7344-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-2a7b84da-ee53-4954-9a16-6aec426d7344-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:56 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.info" returned: 0 in 0.355s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:56 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.info is being set with open permissions: ugo+rw Sep 23 00:26:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:56 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.info Sep 23 00:26:56 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-2a7b84da-ee53-4954-9a16-6aec426d7344" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-2a7b84da-ee53-4954-9a16-6aec426d7344" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:56 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0700094-b6cd-411b-9bc2-24a1e213a1a3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:57 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 Sep 23 00:26:57 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:57 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.info" returned: 0 in 0.339s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Acquiring lock "cinder-quobyte-b3408c53-67a5-47c0-a0d4-0a2d04699a0a" by "_copy_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Lock "cinder-quobyte-b3408c53-67a5-47c0-a0d4-0a2d04699a0a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] snapshot: 107a739b-b85f-4f05-b3a5-1b8c4b15fc31, volume: b3408c53-67a5-47c0-a0d4-0a2d04699a0a, {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d110627-0170-4c33-a016-b56cfe630cbd]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:57 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 Sep 23 00:26:57 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:57 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344" returned: 0 in 0.522s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:57 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344 Sep 23 00:26:57 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:57 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31" returned: 0 in 0.510s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63e78bfe-6988-4bb5-9b2d-feb05672d112(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:26:57 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2a7b84da-ee53-4954-9a16-6aec426d7344" returned: 0 in 0.317s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c7b2f1-0afb-4340-aa47-cc4f4b3bd490]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-2a7b84da-ee53-4954-9a16-6aec426d7344" released by "delete_volume" :: held 0.933s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Created reservations ['80cbdb3c-803c-4bdd-8652-3d62c9a8ff13', 'e019f011-c0bd-40a2-9cfb-050b827c4e95', '4e237411-9956-48bc-850f-bf3309b45dd6', '83d58d7c-42de-4691-90dd-74a48356b94f'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:26:57 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 Sep 23 00:26:57 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:58 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:26:58 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:58 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112" returned: 0 in 0.485s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:26:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Creating direct copy from snapshot {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:26:58 devstack cinder-volume[86481]: DEBUG cinder.utils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Path /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a not found in is_blk_device check {{(pid=86481) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:26:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:58 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a Sep 23 00:26:58 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:58 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.361s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:58 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:58 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Deleted volume successfully. Sep 23 00:26:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cc94cbc6-23f8-4a8d-8775-019e2782f692 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-2a7b84da-ee53-4954-9a16-6aec426d7344-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:26:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-a79df44b-eb1f-4b45-9484-d3e2bedc1522-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-a79df44b-eb1f-4b45-9484-d3e2bedc1522-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "cinder-quobyte-a79df44b-eb1f-4b45-9484-d3e2bedc1522" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:26:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-a79df44b-eb1f-4b45-9484-d3e2bedc1522" acquired by "delete_volume" :: waited 0.037s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:26:59 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[147d2e7a-df6e-4671-a6de-b52d6e1eca17]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:00 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 Sep 23 00:27:00 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:01 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522" returned: 0 in 1.440s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:01 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522 Sep 23 00:27:01 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:01 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a79df44b-eb1f-4b45-9484-d3e2bedc1522" returned: 0 in 0.573s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-quobyte-a79df44b-eb1f-4b45-9484-d3e2bedc1522" released by "delete_volume" :: held 2.218s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:02 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Created reservations ['6da0c2cb-105d-4060-963c-75b62e9f36fe', '86d4c696-144f-479a-ab9f-5337a6cb1d8e', 'd3279b84-95c5-4f74-8093-03814410b6aa', '9adc8c0c-fd27-4b5a-88a7-27a818808626'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:02 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:27:02 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:03 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.839s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:03 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:03 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Deleted volume successfully. Sep 23 00:27:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6700470a-7537-463f-b20f-0e6efa3c2e05 tempest-VolumesSnapshotTestJSON-1382101784 None] Lock "cinder-a79df44b-eb1f-4b45-9484-d3e2bedc1522-delete_volume" released by "delete_volume" :: held 3.890s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:07 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a" returned: 0 in 9.334s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:07 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112, size 1024.00 MB, duration 9.33 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:27:07 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Converted 1024.00 MB image at 109.70 MB/s Sep 23 00:27:07 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a is being set with open permissions: ugo+rw Sep 23 00:27:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:07 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a Sep 23 00:27:07 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:07 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a" returned: 0 in 0.267s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Lock "cinder-quobyte-b3408c53-67a5-47c0-a0d4-0a2d04699a0a" released by "_copy_volume_from_snapshot" :: held 10.697s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Acquiring lock "cinder-quobyte-107a739b-b85f-4f05-b3a5-1b8c4b15fc31" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Lock "cinder-quobyte-107a739b-b85f-4f05-b3a5-1b8c4b15fc31" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Deleting offline snapshot 107a739b-b85f-4f05-b3a5-1b8c4b15fc31 of volume 63e78bfe-6988-4bb5-9b2d-feb05672d112 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:27:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] snapshot_file for this snap is: volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:27:07 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[207d67ed-533e-4a4b-a047-d39a1534e1fb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:08 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 Sep 23 00:27:08 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:08 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31" returned: 0 in 0.469s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63e78bfe-6988-4bb5-9b2d-feb05672d112(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:08 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a55ba0-c0b1-4ea6-8693-1bc61e9e1ce5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:08 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 Sep 23 00:27:08 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:09 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112" returned: 0 in 0.578s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:09 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 Sep 23 00:27:09 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:09 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31" returned: 0 in 0.395s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:09 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31 Sep 23 00:27:09 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:09 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112.107a739b-b85f-4f05-b3a5-1b8c4b15fc31" returned: 0 in 0.409s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:09 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Lock "cinder-quobyte-107a739b-b85f-4f05-b3a5-1b8c4b15fc31" released by "_delete_snapshot" :: held 1.982s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.356s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df9eb93-65f0-437d-9158-c62b0ab6f4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a', 'volume_size': 2, 'source_volid': '63e78bfe-6988-4bb5-9b2d-feb05672d112', 'source_volstatus': 'available'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:09 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990b9679-30dd-430a-987a-01bdd985a749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:09 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Volume volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a (b3408c53-67a5-47c0-a0d4-0a2d04699a0a): created successfully Sep 23 00:27:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990b9679-30dd-430a-987a-01bdd985a749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Flow 'volume_create_manager' (8f7355f9-e026-4e17-bb2a-7b507eb864f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:10 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3b160cb8-f68a-44d6-90b5-aa0e796e0cf4 tempest-VolumesCloneTest-1435288770 None] Created volume successfully. Sep 23 00:27:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Acquiring lock "cinder-b3408c53-67a5-47c0-a0d4-0a2d04699a0a-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Lock "cinder-b3408c53-67a5-47c0-a0d4-0a2d04699a0a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Acquiring lock "cinder-quobyte-b3408c53-67a5-47c0-a0d4-0a2d04699a0a" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Lock "cinder-quobyte-b3408c53-67a5-47c0-a0d4-0a2d04699a0a" acquired by "delete_volume" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:11 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed046e3b-6caa-4e5c-898e-9dfca4ac2464]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:11 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a Sep 23 00:27:11 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:11 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a" returned: 0 in 0.575s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:11 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a Sep 23 00:27:11 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:11 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b3408c53-67a5-47c0-a0d4-0a2d04699a0a" returned: 0 in 0.342s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Lock "cinder-quobyte-b3408c53-67a5-47c0-a0d4-0a2d04699a0a" released by "delete_volume" :: held 0.993s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:12 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Created reservations ['f8a4301e-2951-4b91-ab7f-b052acc16d82', '0d52c4c0-df0a-49a2-99ea-40a395a9da49', '1cc7bf6a-1732-4dad-be3d-81993a0951fe', '08a42ee3-ee6f-4712-a9af-25648eaa40f1'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:12 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:27:12 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:12 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.367s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:12 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:12 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Deleted volume successfully. Sep 23 00:27:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4a596678-25ce-4281-a402-843fbe790bc1 tempest-VolumesCloneTest-1435288770 None] Lock "cinder-b3408c53-67a5-47c0-a0d4-0a2d04699a0a-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Acquiring lock "cinder-63e78bfe-6988-4bb5-9b2d-feb05672d112-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Lock "cinder-63e78bfe-6988-4bb5-9b2d-feb05672d112-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Acquiring lock "cinder-quobyte-63e78bfe-6988-4bb5-9b2d-feb05672d112" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Lock "cinder-quobyte-63e78bfe-6988-4bb5-9b2d-feb05672d112" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:13 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da3217b-2c3d-486f-99f7-c96fae3b45d7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:13 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 Sep 23 00:27:13 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:14 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112" returned: 0 in 0.549s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:14 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112 Sep 23 00:27:14 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:14 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63e78bfe-6988-4bb5-9b2d-feb05672d112" returned: 0 in 0.372s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Lock "cinder-quobyte-63e78bfe-6988-4bb5-9b2d-feb05672d112" released by "delete_volume" :: held 1.036s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:14 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Created reservations ['6a5f5fc8-f79b-4140-a8df-e65c6a8e2f02', '461b0d4c-f284-4dd4-97f4-29f23104395c', 'e14f2783-aa9e-4be5-82ce-251d2fba5856', 'ab3cdc55-0d74-43ca-aef4-2bcf33be2e28'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:14 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:27:14 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:15 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.366s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:15 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Deleted volume successfully. Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f822e600-f15d-43a7-bfec-ae4326ec925f tempest-VolumesCloneTest-1435288770 None] Lock "cinder-63e78bfe-6988-4bb5-9b2d-feb05672d112-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Flow 'volume_create_manager' (477e975c-bd64-4f36-bbc3-de155e3c374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8abc676-5e33-499b-a35b-323ec764f4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8abc676-5e33-499b-a35b-323ec764f4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-423868936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92ad947-b6f0-454e-82a7-8fdb77c2de02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd19df16d614894a4e3af958c6e7a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:15Z,use_quota=True,user_id='78817af4a6e8482c921e11d48c958379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a76f0b6-4cb8-476b-9ea4-f5037de42c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a76f0b6-4cb8-476b-9ea4-f5037de42c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cfbeed-d601-4112-a926-7cac0f22d599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cfbeed-d601-4112-a926-7cac0f22d599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f92ad947-b6f0-454e-82a7-8fdb77c2de02', 'volume_name': 'volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82ff188-2728-462f-af47-9519c745b7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82ff188-2728-462f-af47-9519c745b7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f81cc4f-1232-4af0-97e5-85b6c456d8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:15 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Volume f92ad947-b6f0-454e-82a7-8fdb77c2de02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02', 'volume_size': 1} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-423868936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92ad947-b6f0-454e-82a7-8fdb77c2de02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd19df16d614894a4e3af958c6e7a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:15Z,use_quota=True,user_id='78817af4a6e8482c921e11d48c958379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Creating volume f92ad947-b6f0-454e-82a7-8fdb77c2de02 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:15 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:27:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:15 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 1073741824 Sep 23 00:27:15 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:16 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 1073741824" returned: 0 in 0.622s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:16 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 Sep 23 00:27:16 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:16 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02" returned: 0 in 0.333s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f81cc4f-1232-4af0-97e5-85b6c456d8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585d9706-0eda-4e8c-8147-49862e4763f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:16 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Volume volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 (f92ad947-b6f0-454e-82a7-8fdb77c2de02): created successfully Sep 23 00:27:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585d9706-0eda-4e8c-8147-49862e4763f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Flow 'volume_create_manager' (477e975c-bd64-4f36-bbc3-de155e3c374f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-945978a6-3395-4365-bc35-5b6cc99326fb tempest-VolumesSnapshotListTestJSON-1281854834 None] Created volume successfully. Sep 23 00:27:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] Creating offline snapshot 2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd of volume f92ad947-b6f0-454e-82a7-8fdb77c2de02 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:27:17 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe27386-38af-437e-b6be-5ad3702e2b4e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:18 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 Sep 23 00:27:18 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:18 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02" returned: 0 in 0.440s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:18 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd 1G Sep 23 00:27:18 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:18 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd 1G" returned: 0 in 0.548s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:18 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd Sep 23 00:27:18 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:19 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd" returned: 0 in 0.339s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:19 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd is being set with open permissions: ugo+rw Sep 23 00:27:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:19 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd Sep 23 00:27:19 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:19 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd" returned: 0 in 0.325s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:19 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.info Sep 23 00:27:19 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:19 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.info" returned: 0 in 0.291s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:19 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.info is being set with open permissions: ugo+rw Sep 23 00:27:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:19 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.info Sep 23 00:27:19 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:20 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.info" returned: 0 in 0.352s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (e06d6c82-8ad7-4498-944c-4962b1c71eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2e01e9-2cd8-42bd-b0c3-c4451880d3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-28dcf799-708d-4122-a2e2-190f65ae77a7 tempest-VolumesSnapshotListTestJSON-1281854834 None] Create snapshot completed successfully Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2e01e9-2cd8-42bd-b0c3-c4451880d3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-48576894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:20Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4eb247-84d4-44f8-a289-1139bb904150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4eb247-84d4-44f8-a289-1139bb904150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12884ac4-293a-439b-887d-fa3c287994f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12884ac4-293a-439b-887d-fa3c287994f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514', 'volume_name': 'volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eec6d5c-11ba-4881-b50e-459c9c159ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eec6d5c-11ba-4881-b50e-459c9c159ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd50d10-6c65-40f7-bc59-df957593536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:20 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Volume fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514', 'volume_size': 1} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-48576894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:20Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Creating volume fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:20 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:20 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514 1073741824 Sep 23 00:27:20 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:20 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514 1073741824" returned: 0 in 0.500s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:21 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514 Sep 23 00:27:21 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:21 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514" returned: 0 in 0.358s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd50d10-6c65-40f7-bc59-df957593536d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff8de0f-c35c-4fde-bec9-78bd31ea18ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:21 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Volume volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514 (fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514): created successfully Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff8de0f-c35c-4fde-bec9-78bd31ea18ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (e06d6c82-8ad7-4498-944c-4962b1c71eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:21 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c60cc774-0253-46d9-b4b0-6c40b74f359d tempest-VolumesGetTest-499944950 None] Created volume successfully. Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] Creating offline snapshot 47d46d75-9a7f-4a9b-bc56-5f4121186263 of volume f92ad947-b6f0-454e-82a7-8fdb77c2de02 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbffd40-7dfb-49c6-af93-755d858704d0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:21 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd Sep 23 00:27:21 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:22 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd" returned: 0 in 0.515s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:22 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 1G Sep 23 00:27:22 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:22 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 1G" returned: 0 in 0.701s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:22 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 Sep 23 00:27:22 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:23 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263" returned: 0 in 0.435s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:23 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 is being set with open permissions: ugo+rw Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:23 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 Sep 23 00:27:23 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:23 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263" returned: 0 in 0.344s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (d2b4ef86-d0f4-4f6a-9290-4ea2f008d482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5225c620-a49e-4bf1-867b-d7496e0a0c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5225c620-a49e-4bf1-867b-d7496e0a0c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-876806636',display_name='tempest-VolumesGetTest-Volume-2084034435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:24Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f48df6-a903-4003-b9c9-f76e10dc0533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f48df6-a903-4003-b9c9-f76e10dc0533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee11dae0-5eb5-4f8c-a200-052cd9fd6cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee11dae0-5eb5-4f8c-a200-052cd9fd6cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1', 'volume_name': 'volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46f583f-52c1-4dc2-81d6-d3b341aeb1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46f583f-52c1-4dc2-81d6-d3b341aeb1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e582d4f-f226-46ce-8c39-8844911885ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:23 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Volume 25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1', 'volume_size': 1} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-876806636',display_name='tempest-VolumesGetTest-Volume-2084034435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:24Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Creating volume 25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:23 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:27:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:23 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1 1073741824 Sep 23 00:27:23 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-584bdee7-dc98-4299-9511-c82f5cf19599 tempest-VolumesSnapshotListTestJSON-1281854834 None] Create snapshot completed successfully Sep 23 00:27:24 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1 1073741824" returned: 0 in 0.514s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:24 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1 Sep 23 00:27:24 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:24 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1" returned: 0 in 0.326s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e582d4f-f226-46ce-8c39-8844911885ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65dfddda-fd7b-4ead-afc3-4ca398d6b35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:24 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Volume volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1 (25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1): created successfully Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65dfddda-fd7b-4ead-afc3-4ca398d6b35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (d2b4ef86-d0f4-4f6a-9290-4ea2f008d482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:24 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b88ce640-08f4-471e-8acb-5be371cb5594 tempest-VolumesGetTest-499944950 None] Created volume successfully. Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] Creating offline snapshot 20a23df2-b488-43ec-9fa2-fa85e3963609 of volume f92ad947-b6f0-454e-82a7-8fdb77c2de02 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[250d7d1d-c242-4d4b-86ae-9998a83012be]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:25 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 Sep 23 00:27:25 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:25 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263" returned: 0 in 0.477s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:25 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 1G Sep 23 00:27:25 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Lock "cinder-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-quobyte-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1" acquired by "delete_volume" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:25 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a934cc2b-0e09-406a-8a9e-8f8c9f1c150e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:26 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 1G" returned: 0 in 0.664s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:26 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 Sep 23 00:27:26 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:26 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1 Sep 23 00:27:26 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:26 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1" returned: 0 in 0.458s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:26 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609" returned: 0 in 0.417s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:26 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 is being set with open permissions: ugo+rw Sep 23 00:27:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:26 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1 Sep 23 00:27:26 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:26 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 Sep 23 00:27:26 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:26 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1" returned: 0 in 0.360s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1" released by "delete_volume" :: held 0.889s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:26 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609" returned: 0 in 0.385s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:26 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c0372f6c-ca77-45a2-8522-cde3b9789ff6 tempest-VolumesSnapshotListTestJSON-1281854834 None] Create snapshot completed successfully Sep 23 00:27:26 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Created reservations ['a4baa59e-d658-4e0f-a8c3-c686e2371259', '40cb1f4f-4a68-4087-827c-69cadce65dce', '2a5a4131-b8d7-46b3-81c6-6c428105f7b7', 'ad60fd93-1336-4f87-b02a-d6bb15b74eb8'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:27 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:27:27 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:27 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.364s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:27 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:27 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Deleted volume successfully. Sep 23 00:27:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-85a81452-7579-4991-b1f8-c558105a0d6e tempest-VolumesGetTest-499944950 None] Lock "cinder-25a38f9b-2e1d-49bf-b9fb-b4bbcc0e38b1-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Lock "cinder-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-quobyte-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:28 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[da88bb57-4eff-4756-9a06-7f302da5ac9d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:28 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514 Sep 23 00:27:28 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:29 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514" returned: 0 in 1.002s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:29 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514 Sep 23 00:27:29 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "cinder-20a23df2-b488-43ec-9fa2-fa85e3963609-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-20a23df2-b488-43ec-9fa2-fa85e3963609-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "cinder-quobyte-f92ad947-b6f0-454e-82a7-8fdb77c2de02" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-f92ad947-b6f0-454e-82a7-8fdb77c2de02" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "cinder-quobyte-20a23df2-b488-43ec-9fa2-fa85e3963609" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-20a23df2-b488-43ec-9fa2-fa85e3963609" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Deleting offline snapshot 20a23df2-b488-43ec-9fa2-fa85e3963609 of volume f92ad947-b6f0-454e-82a7-8fdb77c2de02 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] snapshot_file for this snap is: volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2392dee-c15d-4729-ba91-4f93b8e4faf7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:30 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514" returned: 0 in 0.366s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514" released by "delete_volume" :: held 1.446s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:30 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Created reservations ['2085520f-e10a-40da-b84e-1d4eb4c905d3', '79502c59-e12f-4854-b951-c03a9847d999', '0028027f-aae2-4ca1-b3f0-5d2ba83ec8be', '9aba3bca-38fa-463c-9134-2f8f79491f3e'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:30 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:30 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:27:30 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:30 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609" returned: 0 in 0.529s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7653b99-a66f-49af-b0e5-3bd5a789db54]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:30 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.512s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:30 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Deleted volume successfully. Sep 23 00:27:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7ba5a60f-8ed1-4ae1-a1f9-cb40a35a8937 tempest-VolumesGetTest-499944950 None] Lock "cinder-fa0eef5c-b8a6-4e2a-9afe-ee9f1c67e514-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:30 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 Sep 23 00:27:30 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:31 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-bcab1cf3-1a81-4ff3-baf5-a3ebff70a1cd tempest-TestShelveInstance-7289932 None] Terminate volume connection completed successfully. Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-bcab1cf3-1a81-4ff3-baf5-a3ebff70a1cd tempest-TestShelveInstance-7289932 None] Deleting attachment 187d3265-a8f2-4610-8b4d-5b82b2d520f6. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:27:31 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263" returned: 0 in 0.720s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:31 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 Sep 23 00:27:31 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Acquiring lock "cinder-4c59233e-b655-4df5-9261-f9b121fba3dd-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Lock "cinder-4c59233e-b655-4df5-9261-f9b121fba3dd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Acquiring lock "cinder-quobyte-4c59233e-b655-4df5-9261-f9b121fba3dd" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Lock "cinder-quobyte-4c59233e-b655-4df5-9261-f9b121fba3dd" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[4713bd97-960f-4a70-ba71-e8c835e01394]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (19ca80d0-120b-4a91-9820-0c01aa5e8d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b3cc0f-117b-4c30-bf5f-cfe8e7f4b596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b3cc0f-117b-4c30-bf5f-cfe8e7f4b596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1871968193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb52b039-696e-4766-82d2-b837d0c231ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:32Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0813ad1e-cd1a-4714-8a9f-d9374dcbe38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0813ad1e-cd1a-4714-8a9f-d9374dcbe38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c0f7dc-c93a-4006-9acd-9400779b5dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c0f7dc-c93a-4006-9acd-9400779b5dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb52b039-696e-4766-82d2-b837d0c231ba', 'volume_name': 'volume-cb52b039-696e-4766-82d2-b837d0c231ba', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e22b9c8-981d-4131-8b19-c3ad23215b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:31 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd Sep 23 00:27:31 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e22b9c8-981d-4131-8b19-c3ad23215b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4274c2e-6237-4fed-8936-379cce710c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:31 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Volume cb52b039-696e-4766-82d2-b837d0c231ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb52b039-696e-4766-82d2-b837d0c231ba', 'volume_size': 1} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1871968193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb52b039-696e-4766-82d2-b837d0c231ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:32Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Creating volume cb52b039-696e-4766-82d2-b837d0c231ba {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:31 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:27:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:32 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba 1073741824 Sep 23 00:27:32 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:32 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609" returned: 0 in 0.892s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:32 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609 Sep 23 00:27:32 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:32 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd" returned: 0 in 0.665s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:32 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd Sep 23 00:27:32 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:32 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.20a23df2-b488-43ec-9fa2-fa85e3963609" returned: 0 in 0.430s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4c59233e-b655-4df5-9261-f9b121fba3dd" returned: 0 in 0.365s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-20a23df2-b488-43ec-9fa2-fa85e3963609" released by "_delete_snapshot" :: held 2.762s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-f92ad947-b6f0-454e-82a7-8fdb77c2de02" released by "delete_snapshot" :: held 2.796s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Lock "cinder-quobyte-4c59233e-b655-4df5-9261-f9b121fba3dd" released by "delete_volume" :: held 1.123s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:32 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba 1073741824" returned: 0 in 0.841s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG cinder.quota [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Created reservations ['241b836f-6398-4af8-8ecb-c4e23c75b572', '7c019494-0f59-428a-b82b-c909f3c5e997', 'c36e4c4c-88bf-49e3-942c-681e13673697', '046c4bed-919c-4e91-95bf-b4466f731f16'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:32 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Created reservations ['ffd49d26-b0da-475a-ad3c-e98f62a8a855', '5bda9b69-2f1f-43bf-890d-4e3ee64e38e6', '80b55659-b9f9-4775-98c7-3ce591a1edb1', '4434722f-6fc5-4099-943f-26dd73dae481'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:32 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba Sep 23 00:27:32 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:33 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:27:33 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:33 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Delete snapshot completed successfully. Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b723b6bc-29a9-4977-bbfe-36d412157383 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-20a23df2-b488-43ec-9fa2-fa85e3963609-delete_snapshot" released by "delete_snapshot" :: held 3.129s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:33 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "cinder-47d46d75-9a7f-4a9b-bc56-5f4121186263-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba" returned: 0 in 0.390s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4274c2e-6237-4fed-8936-379cce710c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb52b039-696e-4766-82d2-b837d0c231ba', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2841070-f117-468b-9aa5-9b632bda159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-47d46d75-9a7f-4a9b-bc56-5f4121186263-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "cinder-quobyte-f92ad947-b6f0-454e-82a7-8fdb77c2de02" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:33 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Volume volume-cb52b039-696e-4766-82d2-b837d0c231ba (cb52b039-696e-4766-82d2-b837d0c231ba): created successfully Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2841070-f117-468b-9aa5-9b632bda159e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (19ca80d0-120b-4a91-9820-0c01aa5e8d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-f92ad947-b6f0-454e-82a7-8fdb77c2de02" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "cinder-quobyte-47d46d75-9a7f-4a9b-bc56-5f4121186263" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-47d46d75-9a7f-4a9b-bc56-5f4121186263" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Deleting offline snapshot 47d46d75-9a7f-4a9b-bc56-5f4121186263 of volume f92ad947-b6f0-454e-82a7-8fdb77c2de02 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] snapshot_file for this snap is: volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:27:33 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e577750a-f5d2-4268-9ba9-b6d01668c9de tempest-VolumesGetTest-499944950 None] Created volume successfully. Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce8e2f9-612b-43f0-859a-7f0a9839e280]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:33 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.457s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.manager [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:33 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Deleted volume successfully. Sep 23 00:27:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [req-c43bead0-0b76-4be1-872d-ce0da1bbba92 req-f0cbf499-26ad-428f-a38a-f1416e6c91c4 tempest-TestShelveInstance-7289932 None] Lock "cinder-4c59233e-b655-4df5-9261-f9b121fba3dd-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:33 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 Sep 23 00:27:33 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:34 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263" returned: 0 in 0.641s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5903bbc1-4926-47b9-8112-821060e01c8e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:34 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd Sep 23 00:27:34 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:34 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd" returned: 0 in 0.568s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:34 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 Sep 23 00:27:34 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (cd9e2e30-7b64-4fa5-abbe-6d7a9fe67fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c14dc6-7e5e-4f4f-8958-230b57b1508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c14dc6-7e5e-4f4f-8958-230b57b1508a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1922003084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4da839-8e8f-4c9d-8491-bfb36b379e7c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cb52b039-696e-4766-82d2-b837d0c231ba,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:35Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95272039-3071-41b9-9565-201ad803ce5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95272039-3071-41b9-9565-201ad803ce5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b356de-5bda-4a64-846c-db7a49e458ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b356de-5bda-4a64-846c-db7a49e458ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5d4da839-8e8f-4c9d-8491-bfb36b379e7c', 'volume_name': 'volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c', 'volume_size': 1, 'source_volid': 'cb52b039-696e-4766-82d2-b837d0c231ba', 'source_volstatus': 'available'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4773b4-093b-4a8c-8ade-11a6e91bb47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4773b4-093b-4a8c-8ade-11a6e91bb47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6653f20f-7ebe-4d87-8110-d81b6a9a5e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:35 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Volume 5d4da839-8e8f-4c9d-8491-bfb36b379e7c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c', 'volume_size': 1, 'source_volid': 'cb52b039-696e-4766-82d2-b837d0c231ba', 'source_volstatus': 'available'} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:35 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Cloning volume cb52b039-696e-4766-82d2-b837d0c231ba to volume 5d4da839-8e8f-4c9d-8491-bfb36b379e7c Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Creating offline snapshot ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d of volume cb52b039-696e-4766-82d2-b837d0c231ba {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32cd220-6c75-4d0d-b4ff-19749166004b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:35 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba Sep 23 00:27:35 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:35 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263" returned: 0 in 0.613s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:35 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263 Sep 23 00:27:35 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:35 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:35 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba" returned: 0 in 0.498s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.47d46d75-9a7f-4a9b-bc56-5f4121186263" returned: 0 in 0.303s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:35 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d 1G Sep 23 00:27:35 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-47d46d75-9a7f-4a9b-bc56-5f4121186263" released by "_delete_snapshot" :: held 2.272s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-f92ad947-b6f0-454e-82a7-8fdb77c2de02" released by "delete_snapshot" :: held 2.319s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Created reservations ['bfde920a-0aa7-48cd-93fc-db31b493f776', 'af4a10ce-8c40-42aa-94de-ee8610a8685e', '20650b02-f93d-4224-8d10-cbcbed7c064d', 'cf2fa623-b8f7-4668-9fd9-15102d8d4010'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:35 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Delete snapshot completed successfully. Sep 23 00:27:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7cb9293d-2671-4f1f-b560-a76009f4b463 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-47d46d75-9a7f-4a9b-bc56-5f4121186263-delete_snapshot" released by "delete_snapshot" :: held 2.581s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:36 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d 1G" returned: 0 in 0.532s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb52b039-696e-4766-82d2-b837d0c231ba -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:36 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb52b039-696e-4766-82d2-b837d0c231ba -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d Sep 23 00:27:36 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "cinder-2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "cinder-quobyte-f92ad947-b6f0-454e-82a7-8fdb77c2de02" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-f92ad947-b6f0-454e-82a7-8fdb77c2de02" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "cinder-quobyte-2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Deleting offline snapshot 2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd of volume f92ad947-b6f0-454e-82a7-8fdb77c2de02 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] snapshot_file for this snap is: volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2a23f9-f89e-441e-812d-49237fe14ed4]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:36 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb52b039-696e-4766-82d2-b837d0c231ba -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d" returned: 0 in 0.467s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:36 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d is being set with open permissions: ugo+rw Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:36 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d Sep 23 00:27:36 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:36 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd Sep 23 00:27:36 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:36 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d" returned: 0 in 0.305s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:36 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.info Sep 23 00:27:36 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:37 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd" returned: 0 in 0.455s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bca953-8bdd-49ba-b16c-b9755b4e7763]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:37 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 Sep 23 00:27:37 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:37 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.info" returned: 0 in 0.323s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:37 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.info is being set with open permissions: ugo+rw Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:37 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.info Sep 23 00:27:37 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:37 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02" returned: 0 in 0.528s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:37 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd Sep 23 00:27:37 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:37 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.info" returned: 0 in 0.381s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-quobyte-5d4da839-8e8f-4c9d-8491-bfb36b379e7c" by "_copy_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-5d4da839-8e8f-4c9d-8491-bfb36b379e7c" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] snapshot: ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d, volume: 5d4da839-8e8f-4c9d-8491-bfb36b379e7c, {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef254807-2343-4ba4-a02f-7aee03f4b146]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:37 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d Sep 23 00:27:37 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:38 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd" returned: 0 in 0.440s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:38 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd Sep 23 00:27:38 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:38 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d" returned: 0 in 0.467s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb52b039-696e-4766-82d2-b837d0c231ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a2d74e-8baf-4aa8-b388-8ae0369d80c6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:38 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba Sep 23 00:27:38 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:38 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02.2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd" returned: 0 in 0.327s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd" released by "_delete_snapshot" :: held 1.915s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-f92ad947-b6f0-454e-82a7-8fdb77c2de02" released by "delete_snapshot" :: held 1.946s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Created reservations ['6179aaa2-1e8b-4359-8949-2ed0ab65371a', '5e0b1aaa-1673-4966-a002-93f59db19329', '24535f5d-17d2-42ea-8cad-1eb4c3e96d7f', '1ebd122d-e0f0-4afa-a4e9-5cef3b2f61b8'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:38 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Delete snapshot completed successfully. Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-78a1c796-ee7a-4125-b64a-7c44e60c466c tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-2d12e2db-bbe3-4ca1-a03c-b98efd19e4bd-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:38 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba" returned: 0 in 0.516s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Creating direct copy from snapshot {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG cinder.utils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Path /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c not found in is_blk_device check {{(pid=86481) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:38 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c Sep 23 00:27:38 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "cinder-f92ad947-b6f0-454e-82a7-8fdb77c2de02-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-f92ad947-b6f0-454e-82a7-8fdb77c2de02-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "cinder-quobyte-f92ad947-b6f0-454e-82a7-8fdb77c2de02" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-f92ad947-b6f0-454e-82a7-8fdb77c2de02" acquired by "delete_volume" :: waited 0.048s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:39 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7454bb-2086-4ee3-9cdd-4a63ed9588ed]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:39 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 Sep 23 00:27:39 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:39 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02" returned: 0 in 0.604s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:39 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02 Sep 23 00:27:39 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:40 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f92ad947-b6f0-454e-82a7-8fdb77c2de02" returned: 0 in 0.903s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-quobyte-f92ad947-b6f0-454e-82a7-8fdb77c2de02" released by "delete_volume" :: held 1.640s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:40 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Created reservations ['89f70742-c52e-444c-9768-a795a8425f55', '95c83a1c-6879-4ff5-b354-5deb8e3c3f56', 'cd69b6a9-3375-437a-ac0d-dc9bfa434843', '9dbc1ef7-8ba8-4d4b-8608-78b8ea1ee1f3'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:41 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:41 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:41 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:27:41 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:41 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.622s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:41 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:41 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Deleted volume successfully. Sep 23 00:27:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8948212c-37a3-4a55-8c96-14f54e5405d3 tempest-VolumesSnapshotListTestJSON-1281854834 None] Lock "cinder-f92ad947-b6f0-454e-82a7-8fdb77c2de02-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:27:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:45 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:27:45 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:45 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.473s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:27:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:27:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:27:47 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c" returned: 0 in 8.616s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:47 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba, size 1024.00 MB, duration 8.62 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:27:47 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Converted 1024.00 MB image at 118.82 MB/s Sep 23 00:27:47 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c is being set with open permissions: ugo+rw Sep 23 00:27:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:47 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c Sep 23 00:27:47 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:47 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c" returned: 0 in 0.305s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-5d4da839-8e8f-4c9d-8491-bfb36b379e7c" released by "_copy_volume_from_snapshot" :: held 10.009s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-quobyte-ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Deleting offline snapshot ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d of volume cb52b039-696e-4766-82d2-b837d0c231ba {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:27:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] snapshot_file for this snap is: volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:27:47 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2b6966-f969-40d8-9344-f75ab4ef6111]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:47 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d Sep 23 00:27:47 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:48 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d" returned: 0 in 0.539s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb52b039-696e-4766-82d2-b837d0c231ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:48 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b736da02-4008-4c08-ac3c-4a9d4d73580b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:48 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba Sep 23 00:27:48 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:49 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba" returned: 0 in 0.685s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:49 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d Sep 23 00:27:49 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:49 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d" returned: 0 in 0.612s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:49 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d Sep 23 00:27:49 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:50 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba.ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d" returned: 0 in 0.347s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-ffbf1177-5b2b-40c5-9f45-3cf0a2c5a91d" released by "_delete_snapshot" :: held 2.332s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:50 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=101,cinder:UPDATE=119,cinder:INSERT=36,cinder:DELETE=11 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.154s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6653f20f-7ebe-4d87-8110-d81b6a9a5e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c', 'volume_size': 1, 'source_volid': 'cb52b039-696e-4766-82d2-b837d0c231ba', 'source_volstatus': 'available'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025875b7-9140-4807-9b3b-7d54497a622a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:50 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Volume volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c (5d4da839-8e8f-4c9d-8491-bfb36b379e7c): created successfully Sep 23 00:27:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025875b7-9140-4807-9b3b-7d54497a622a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (cd9e2e30-7b64-4fa5-abbe-6d7a9fe67fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:50 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d224e158-d577-4b4a-89e3-e4dae88212f7 tempest-VolumesGetTest-499944950 None] Created volume successfully. Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=129,cinder:SELECT=93,cinder:DELETE=8,cinder:INSERT=29 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (cce77ef8-b9a2-4522-9e0e-4d9077c88901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a8daf2-04bc-42bf-9052-1ec79a6ac669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a8daf2-04bc-42bf-9052-1ec79a6ac669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1370713897',display_name='tempest-VolumesGetTest-Volume-724968639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691e2650-7aaf-4052-b1ea-d733c1be5ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:51Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31367893-8bd1-4de7-bd24-09a9bd313815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31367893-8bd1-4de7-bd24-09a9bd313815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e52de7a-b5d9-4a68-a7f7-98013c251e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e52de7a-b5d9-4a68-a7f7-98013c251e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691e2650-7aaf-4052-b1ea-d733c1be5ccf', 'volume_name': 'volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f898d0-e8af-44ac-82fb-b74aaa26eec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f898d0-e8af-44ac-82fb-b74aaa26eec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01aa834-6cc9-4b17-aaa4-4648df82677b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:51 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Volume 691e2650-7aaf-4052-b1ea-d733c1be5ccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf', 'volume_size': 1} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1370713897',display_name='tempest-VolumesGetTest-Volume-724968639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691e2650-7aaf-4052-b1ea-d733c1be5ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:51Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Creating volume 691e2650-7aaf-4052-b1ea-d733c1be5ccf {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:51 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:27:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:51 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf 1073741824 Sep 23 00:27:51 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:52 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf 1073741824" returned: 0 in 0.631s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:52 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf Sep 23 00:27:52 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:52 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf" returned: 0 in 0.371s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:27:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01aa834-6cc9-4b17-aaa4-4648df82677b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16de9de0-82d6-48e7-9a67-fc27c008e650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:52 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Volume volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf (691e2650-7aaf-4052-b1ea-d733c1be5ccf): created successfully Sep 23 00:27:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16de9de0-82d6-48e7-9a67-fc27c008e650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (cce77ef8-b9a2-4522-9e0e-4d9077c88901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:52 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-8458cdd4-f73b-4558-a45a-1c86072bfc41 tempest-VolumesGetTest-499944950 None] Created volume successfully. Sep 23 00:27:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-691e2650-7aaf-4052-b1ea-d733c1be5ccf-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Lock "cinder-691e2650-7aaf-4052-b1ea-d733c1be5ccf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-quobyte-691e2650-7aaf-4052-b1ea-d733c1be5ccf" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-691e2650-7aaf-4052-b1ea-d733c1be5ccf" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[25175e9d-75ff-4d40-a67d-c21a88ca53da]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:54 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf Sep 23 00:27:54 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:54 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf" returned: 0 in 0.448s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:54 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf Sep 23 00:27:54 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:54 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-691e2650-7aaf-4052-b1ea-d733c1be5ccf" returned: 0 in 0.312s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-691e2650-7aaf-4052-b1ea-d733c1be5ccf" released by "delete_volume" :: held 0.820s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Created reservations ['49bc04cb-b195-46f4-a07d-e9b5c22a831e', 'd98ec865-bfd2-49d9-b14a-cdda603bb9ad', 'f4c82ded-5bc0-4754-add0-cb1624f193cb', 'c642cefd-3d1a-4a19-9ae7-fb9bc31d4e71'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:55 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:27:55 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-5d4da839-8e8f-4c9d-8491-bfb36b379e7c-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Lock "cinder-5d4da839-8e8f-4c9d-8491-bfb36b379e7c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:55 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-quobyte-5d4da839-8e8f-4c9d-8491-bfb36b379e7c" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.479s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:55 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:55 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Deleted volume successfully. Sep 23 00:27:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-5d4da839-8e8f-4c9d-8491-bfb36b379e7c" acquired by "delete_volume" :: waited 0.038s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1743ab2b-25ff-4e04-91d4-e1bc3e67eed5 tempest-VolumesGetTest-499944950 None] Lock "cinder-691e2650-7aaf-4052-b1ea-d733c1be5ccf-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:55 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cab261-344e-4ac8-ae8c-ae243e974687]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:55 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c Sep 23 00:27:55 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:56 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c" returned: 0 in 0.571s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:56 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c Sep 23 00:27:56 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:56 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5d4da839-8e8f-4c9d-8491-bfb36b379e7c" returned: 0 in 0.323s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-5d4da839-8e8f-4c9d-8491-bfb36b379e7c" released by "delete_volume" :: held 0.981s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:56 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Created reservations ['b39cd697-306c-4261-8785-1177444c1c5c', '17136ad4-0196-4dd0-b9bb-707c5c616a34', 'feb2f8e9-9a22-41ab-8694-b035651fc847', '77b1c05a-541d-4b04-a552-99b7ebe2021f'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:56 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:27:56 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:57 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.385s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:57 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:57 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Deleted volume successfully. Sep 23 00:27:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9b00c2b4-8967-4332-82d5-aea27226311b tempest-VolumesGetTest-499944950 None] Lock "cinder-5d4da839-8e8f-4c9d-8491-bfb36b379e7c-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-cb52b039-696e-4766-82d2-b837d0c231ba-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Lock "cinder-cb52b039-696e-4766-82d2-b837d0c231ba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-quobyte-cb52b039-696e-4766-82d2-b837d0c231ba" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-cb52b039-696e-4766-82d2-b837d0c231ba" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:57 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[78194af6-1917-4623-ac03-95bfb41bb26d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:58 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba Sep 23 00:27:58 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:58 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba" returned: 0 in 0.526s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:58 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba Sep 23 00:27:58 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:58 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cb52b039-696e-4766-82d2-b837d0c231ba" returned: 0 in 0.349s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-cb52b039-696e-4766-82d2-b837d0c231ba" released by "delete_volume" :: held 0.977s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:58 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Created reservations ['d31f3c34-8fc9-4ca5-8afc-da56ffecbc07', '4f962633-f307-46e3-b83c-cb63d1ae0b72', 'c004adb5-b55b-407c-8ee9-18d03e54fa00', 'bfe2fa7f-7888-4b52-b4da-5c7f8bb47dc1'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:27:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:59 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:27:59 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:59 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.366s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:59 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Deleted volume successfully. Sep 23 00:27:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0cfeae0d-c08d-4516-8053-c907b06681ab tempest-VolumesGetTest-499944950 None] Lock "cinder-cb52b039-696e-4766-82d2-b837d0c231ba-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:01 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (47d33f91-76b7-437e-9cba-c1c0019c1c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c467dfa4-b4bc-4f10-b965-0ea6922271f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c467dfa4-b4bc-4f10-b965-0ea6922271f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2097632202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6e1939-6c4b-4fb6-861e-8e52b604d9e6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:02Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc6aaad-29ae-4b8a-96a0-e73f16a2e14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc6aaad-29ae-4b8a-96a0-e73f16a2e14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b18214-b207-4de3-b614-d41faf8b654b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:01 devstack cinder-volume[86481]: DEBUG cinder.image.glance [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Creating Keystone auth plugin from conf {{(pid=86481) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:28:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b18214-b207-4de3-b614-d41faf8b654b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e6e1939-6c4b-4fb6-861e-8e52b604d9e6', 'volume_name': 'volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7bb330-a305-42b0-b9d0-77fc33276af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7bb330-a305-42b0-b9d0-77fc33276af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba418dfc-57f1-4530-bd5a-4738a0c2b8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:02 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Volume 2e6e1939-6c4b-4fb6-861e-8e52b604d9e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:28:02 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Trying to clone 2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 from image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]). {{(pid=86481) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:28:03 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:28:03 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:28:03 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5248ba0e-2284-4b0b-a2d3-e9b269cd4adb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:03 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD Sep 23 00:28:03 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:03 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD" returned: 0 in 0.504s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:03 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Temporary image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 is fetched for user 9363ba80991340aa9534b7c48d09c89f. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:28:03 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc930aec-ff37-45cc-a653-a227efa42ef8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:03 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD Sep 23 00:28:03 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:04 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2097632202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6e1939-6c4b-4fb6-861e-8e52b604d9e6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:02Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Creating volume 2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:04 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:04 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 1073741824 Sep 23 00:28:04 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:04 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 1073741824" returned: 0 in 0.689s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:05 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 Sep 23 00:28:05 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:05 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6" returned: 0 in 0.387s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:05 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Attempting download of 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}])) to volume 2e6e1939-6c4b-4fb6-861e-8e52b604d9e6. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:28:05 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5b94c5-9228-4903-9b18-7e5c7ac48023]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_a717rw94 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:05 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_a717rw94 Sep 23 00:28:05 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:05 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_a717rw94" returned: 0 in 0.439s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_a717rw94 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:06 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_a717rw94 Sep 23 00:28:06 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:06 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_a717rw94" returned: 1 in 0.409s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_a717rw94' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:28:06 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[382ada76-306f-422d-b93d-a0be30dc9bb3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:06 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD Sep 23 00:28:06 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:06 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:06 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 was qcow2, converting to qcow2 {{(pid=86481) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:28:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:06 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 Sep 23 00:28:06 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:09 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6" returned: 0 in 2.767s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:09 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2_mbc29osvdevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:28:09 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Converted 112.00 MB image at 40.43 MB/s Sep 23 00:28:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:09 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 1G Sep 23 00:28:09 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:10 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 1G" returned: 0 in 0.441s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:10 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Downloaded image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 ((None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}])) to volume 2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 successfully. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:28:10 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Temporary image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 for user 9363ba80991340aa9534b7c48d09c89f is deleted. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:28:10 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Marking volume 2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 as bootable. {{(pid=86481) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:28:10 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Copying metadata from image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 to 2e6e1939-6c4b-4fb6-861e-8e52b604d9e6. {{(pid=86481) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:28:10 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Creating volume glance metadata for volume 2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 backed by image 338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86481) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:28:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba418dfc-57f1-4530-bd5a-4738a0c2b8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6', 'volume_size': 1, 'image_id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12206294b4ca47bf99c8fc8fa688ca0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2', 'created_at': datetime.datetime(2026, 9, 22, 22, 4, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 4, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/338e5e77-ee7f-4e3b-8ac0-ffc20a393cf2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c5e662-3e77-4b43-8218-0a8854b90f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:10 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Volume volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 (2e6e1939-6c4b-4fb6-861e-8e52b604d9e6): created successfully Sep 23 00:28:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c5e662-3e77-4b43-8218-0a8854b90f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (47d33f91-76b7-437e-9cba-c1c0019c1c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:10 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1eee7752-5b3a-4a43-9cc5-88c549ecbaa3 tempest-VolumesGetTest-499944950 None] Created volume successfully. Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (eba165ac-6ebe-43cb-9fea-150e8ad03122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7264caf9-f32b-4669-90e5-8bb69c1fd9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7264caf9-f32b-4669-90e5-8bb69c1fd9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-772289227',display_name='tempest-VolumesGetTest-Volume-76249146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db665a0a-1b69-4c38-9aed-210326b05826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:11Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80f17c4-8d72-42c4-8483-c82bdb3a29c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80f17c4-8d72-42c4-8483-c82bdb3a29c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f312a6b-4f81-468a-b55a-db8a7488d116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f312a6b-4f81-468a-b55a-db8a7488d116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db665a0a-1b69-4c38-9aed-210326b05826', 'volume_name': 'volume-db665a0a-1b69-4c38-9aed-210326b05826', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe747e07-2810-42f9-b07c-f06cbddcdd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe747e07-2810-42f9-b07c-f06cbddcdd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517f3ee5-f62c-4137-a4d9-eeb65140f999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Volume db665a0a-1b69-4c38-9aed-210326b05826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db665a0a-1b69-4c38-9aed-210326b05826', 'volume_size': 1} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-772289227',display_name='tempest-VolumesGetTest-Volume-76249146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db665a0a-1b69-4c38-9aed-210326b05826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c77ad2bdb7414a9e1c8ae3db282cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:11Z,use_quota=True,user_id='9363ba80991340aa9534b7c48d09c89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Creating volume db665a0a-1b69-4c38-9aed-210326b05826 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:11 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:28:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-db665a0a-1b69-4c38-9aed-210326b05826 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:11 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-db665a0a-1b69-4c38-9aed-210326b05826 1073741824 Sep 23 00:28:11 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:12 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-db665a0a-1b69-4c38-9aed-210326b05826 1073741824" returned: 0 in 0.925s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-db665a0a-1b69-4c38-9aed-210326b05826 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:12 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-db665a0a-1b69-4c38-9aed-210326b05826 Sep 23 00:28:12 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:13 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-db665a0a-1b69-4c38-9aed-210326b05826" returned: 0 in 0.412s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517f3ee5-f62c-4137-a4d9-eeb65140f999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db665a0a-1b69-4c38-9aed-210326b05826', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c66f788-389a-42cf-b1f8-9c62cfa91c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:13 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Volume volume-db665a0a-1b69-4c38-9aed-210326b05826 (db665a0a-1b69-4c38-9aed-210326b05826): created successfully Sep 23 00:28:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c66f788-389a-42cf-b1f8-9c62cfa91c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Flow 'volume_create_manager' (eba165ac-6ebe-43cb-9fea-150e8ad03122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:13 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-68e4206a-0606-442a-87c1-7b6590119e0b tempest-VolumesGetTest-499944950 None] Created volume successfully. Sep 23 00:28:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-db665a0a-1b69-4c38-9aed-210326b05826-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Lock "cinder-db665a0a-1b69-4c38-9aed-210326b05826-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-quobyte-db665a0a-1b69-4c38-9aed-210326b05826" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-db665a0a-1b69-4c38-9aed-210326b05826" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:14 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a40c31-3a89-4165-8d74-3a9e2e741a14]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-db665a0a-1b69-4c38-9aed-210326b05826 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:14 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-db665a0a-1b69-4c38-9aed-210326b05826 Sep 23 00:28:14 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:14 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-db665a0a-1b69-4c38-9aed-210326b05826" returned: 0 in 0.714s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-db665a0a-1b69-4c38-9aed-210326b05826 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:14 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-db665a0a-1b69-4c38-9aed-210326b05826 Sep 23 00:28:14 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:15 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-db665a0a-1b69-4c38-9aed-210326b05826" returned: 0 in 0.371s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-db665a0a-1b69-4c38-9aed-210326b05826" released by "delete_volume" :: held 1.170s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:15 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Created reservations ['8b445115-e79a-4837-bdee-c35228415a63', 'b48434e5-d07a-4962-b108-079b887fc535', 'e3989e42-54d0-4816-b952-5f30cb705907', '08c4b30c-f9b2-4f56-b10f-88cef3ec7237'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:15 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:28:15 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:15 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.372s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:15 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:15 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Deleted volume successfully. Sep 23 00:28:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-cb75b80d-17b2-4607-b1e1-da65dbff4ba3 tempest-VolumesGetTest-499944950 None] Lock "cinder-db665a0a-1b69-4c38-9aed-210326b05826-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Lock "cinder-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Acquiring lock "cinder-quobyte-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:16 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec43311d-6678-4a65-9dba-b30a3839a61a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:16 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 Sep 23 00:28:16 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:17 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6" returned: 0 in 0.481s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:17 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6 Sep 23 00:28:17 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:17 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6" returned: 0 in 0.366s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Lock "cinder-quobyte-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6" released by "delete_volume" :: held 0.936s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:17 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Created reservations ['6a9185df-e916-4b05-a094-8858fba2ec48', 'cf2d597d-4e60-48d4-b480-9c16abce0782', 'a8b7129f-dbe4-4cde-b54e-a8b0bfa97dc3', '5c477e77-9a58-4ab6-b319-f366032ed2a8'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:17 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:28:17 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:18 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.380s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:18 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:18 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Deleted volume successfully. Sep 23 00:28:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9f4b4a05-569f-43e8-adc7-3c19956d8006 tempest-VolumesGetTest-499944950 None] Lock "cinder-2e6e1939-6c4b-4fb6-861e-8e52b604d9e6-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Flow 'volume_create_manager' (a35ab1e6-6a96-44a2-8d9f-4ec11d766927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b332adb-3830-45a2-8368-127f2c08bc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b332adb-3830-45a2-8368-127f2c08bc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1848946143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bce97c-1ff9-4340-a40f-23bb16bc9a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2998b2724c934b5d9e6f2a9c2aa8b6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:24Z,use_quota=True,user_id='33145b7648894020adf5032d341d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b6965f-8ec4-4047-93fa-6c678ea99424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b6965f-8ec4-4047-93fa-6c678ea99424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce42193-779d-4dcc-bfa4-fd2eb2c6f7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce42193-779d-4dcc-bfa4-fd2eb2c6f7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bce97c-1ff9-4340-a40f-23bb16bc9a10', 'volume_name': 'volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fede29c-2060-44e2-a7fd-afaff24b8be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fede29c-2060-44e2-a7fd-afaff24b8be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac032ff-9c72-4180-af88-06ef14864c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:23 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume 63bce97c-1ff9-4340-a40f-23bb16bc9a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10', 'volume_size': 1} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1848946143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bce97c-1ff9-4340-a40f-23bb16bc9a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2998b2724c934b5d9e6f2a9c2aa8b6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:24Z,use_quota=True,user_id='33145b7648894020adf5032d341d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Creating volume 63bce97c-1ff9-4340-a40f-23bb16bc9a10 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:23 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:28:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:24 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 1073741824 Sep 23 00:28:24 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:24 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 1073741824" returned: 0 in 0.664s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:24 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 Sep 23 00:28:24 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:25 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10" returned: 0 in 0.396s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac032ff-9c72-4180-af88-06ef14864c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3f8980-a7a2-4120-a50f-139e372d3cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:25 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 (63bce97c-1ff9-4340-a40f-23bb16bc9a10): created successfully Sep 23 00:28:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3f8980-a7a2-4120-a50f-139e372d3cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Flow 'volume_create_manager' (a35ab1e6-6a96-44a2-8d9f-4ec11d766927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:25 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3f7670c0-cad0-4e0d-8568-66eaca603732 tempest-CreateVolumesFromSnapshotTest-310064184 None] Created volume successfully. Sep 23 00:28:25 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Flow 'volume_create_manager' (cd05314e-b3b5-4dcf-8c2d-5eada463ac6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53af257-5282-4266-9dbb-e290652b0c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53af257-5282-4266-9dbb-e290652b0c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2056677673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa954feb-1f28-486c-9c25-c345921ad673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab63c4e563c84401b2c25a015b4b233a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:26Z,use_quota=True,user_id='940b5fd71c324a03b365780f733a07e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd796b39-e945-4d5d-834c-c23d61de8366),volume_type_id=dd796b39-e945-4d5d-834c-c23d61de8366)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc8b261-4a3d-4711-9a21-6efb874b5fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc8b261-4a3d-4711-9a21-6efb874b5fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1c1917-a716-44a4-a424-04c24167001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1c1917-a716-44a4-a424-04c24167001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa954feb-1f28-486c-9c25-c345921ad673', 'volume_name': 'volume-aa954feb-1f28-486c-9c25-c345921ad673', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a28e263-d427-4f7d-8fd1-7b019da934a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a28e263-d427-4f7d-8fd1-7b019da934a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4db5b7-c22d-4a85-8bc4-5ecb9708191d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:26 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Volume aa954feb-1f28-486c-9c25-c345921ad673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa954feb-1f28-486c-9c25-c345921ad673', 'volume_size': 1} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2056677673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa954feb-1f28-486c-9c25-c345921ad673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab63c4e563c84401b2c25a015b4b233a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:26Z,use_quota=True,user_id='940b5fd71c324a03b365780f733a07e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd796b39-e945-4d5d-834c-c23d61de8366),volume_type_id=dd796b39-e945-4d5d-834c-c23d61de8366)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Creating volume aa954feb-1f28-486c-9c25-c345921ad673 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:26 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-aa954feb-1f28-486c-9c25-c345921ad673 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:26 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-aa954feb-1f28-486c-9c25-c345921ad673 1073741824 Sep 23 00:28:26 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Flow 'volume_create_manager' (32c8cc2b-6c02-4e32-a9e2-be842a30b895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96072b3-8d21-4c93-bd37-0a9f6badf2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96072b3-8d21-4c93-bd37-0a9f6badf2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-156754472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35523e3b-cc6d-4c14-b855-0267b8793d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab63c4e563c84401b2c25a015b4b233a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:27Z,use_quota=True,user_id='940b5fd71c324a03b365780f733a07e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02bda2bb-afce-4741-9fad-dc54e0abdb1c),volume_type_id=02bda2bb-afce-4741-9fad-dc54e0abdb1c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fc7dd6-39d2-449a-933b-8a7c6cd1e692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fc7dd6-39d2-449a-933b-8a7c6cd1e692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b94a45-80d5-4f67-9531-25195bd32855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b94a45-80d5-4f67-9531-25195bd32855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35523e3b-cc6d-4c14-b855-0267b8793d58', 'volume_name': 'volume-35523e3b-cc6d-4c14-b855-0267b8793d58', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807bf580-1078-4842-b162-b7e80a7911ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807bf580-1078-4842-b162-b7e80a7911ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b04956a-6a89-4a26-9b2e-bbffb03c90a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:26 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Volume 35523e3b-cc6d-4c14-b855-0267b8793d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35523e3b-cc6d-4c14-b855-0267b8793d58', 'volume_size': 1} Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:26 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-aa954feb-1f28-486c-9c25-c345921ad673 1073741824" returned: 0 in 0.889s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-aa954feb-1f28-486c-9c25-c345921ad673 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:27 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-aa954feb-1f28-486c-9c25-c345921ad673 Sep 23 00:28:27 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:27 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-aa954feb-1f28-486c-9c25-c345921ad673" returned: 0 in 0.342s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.673s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4db5b7-c22d-4a85-8bc4-5ecb9708191d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa954feb-1f28-486c-9c25-c345921ad673', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9371ba55-1610-4de8-aff0-a3b7b4f4a9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] Creating offline snapshot 1deb95c8-5cc2-4646-a524-cf3edea18836 of volume 63bce97c-1ff9-4340-a40f-23bb16bc9a10 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:28:27 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Volume volume-aa954feb-1f28-486c-9c25-c345921ad673 (aa954feb-1f28-486c-9c25-c345921ad673): created successfully Sep 23 00:28:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9371ba55-1610-4de8-aff0-a3b7b4f4a9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Flow 'volume_create_manager' (cd05314e-b3b5-4dcf-8c2d-5eada463ac6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:27 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8cae9-60f0-4c41-a903-031106f46996]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:27 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-cfde8203-6ac5-49e5-8da2-4950ef8c055a tempest-TestInstancesWithCinderVolumes-1269575785 None] Created volume successfully. Sep 23 00:28:27 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 Sep 23 00:28:27 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Flow 'volume_create_manager' (96de34f8-f8c8-4341-8f85-09d994be53ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7822041-0820-41b9-8a12-544fc43fe85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7822041-0820-41b9-8a12-544fc43fe85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1087985965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6d34ff-a91d-4cf7-94a0-078b93257fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab63c4e563c84401b2c25a015b4b233a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:28Z,use_quota=True,user_id='940b5fd71c324a03b365780f733a07e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28b9ee2d-078c-4e1b-a63d-b7bc5cc86def),volume_type_id=28b9ee2d-078c-4e1b-a63d-b7bc5cc86def)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb26b13-8a1a-4882-a33c-2882160be770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb26b13-8a1a-4882-a33c-2882160be770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a521aa-d9a3-46bc-911d-1b4822e06585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:28 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.image.glance [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Creating Keystone auth plugin from conf {{(pid=86481) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10" returned: 0 in 0.729s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:28 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 1G Sep 23 00:28:28 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a521aa-d9a3-46bc-911d-1b4822e06585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf6d34ff-a91d-4cf7-94a0-078b93257fb8', 'volume_name': 'volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8', 'volume_size': 1, 'image_id': 'dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--207916021', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab63c4e563c84401b2c25a015b4b233a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'created_at': datetime.datetime(2026, 9, 22, 22, 28, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 28, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dab109ce-d88d-40f7-b6e8-65cbb910e6d0/file', 'properties': {}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca09b259-942a-4877-98f1-b9f30e356615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca09b259-942a-4877-98f1-b9f30e356615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8d3ea4-5151-46d2-bf9a-9a563ea906b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:28 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Volume cf6d34ff-a91d-4cf7-94a0-078b93257fb8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8', 'volume_size': 1, 'image_id': 'dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--207916021', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab63c4e563c84401b2c25a015b4b233a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'created_at': datetime.datetime(2026, 9, 22, 22, 28, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 28, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dab109ce-d88d-40f7-b6e8-65cbb910e6d0/file', 'properties': {}}, 'image_service': } Sep 23 00:28:28 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Trying to clone cf6d34ff-a91d-4cf7-94a0-078b93257fb8 from image dab109ce-d88d-40f7-b6e8-65cbb910e6d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'metadata': {}}]). {{(pid=86481) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:28:29 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 1G" returned: 0 in 0.832s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:29 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 Sep 23 00:28:29 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:29 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836" returned: 0 in 0.536s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:29 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 is being set with open permissions: ugo+rw Sep 23 00:28:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:29 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 Sep 23 00:28:29 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:30 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836" returned: 0 in 0.388s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:30 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.info Sep 23 00:28:30 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:30 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.info" returned: 0 in 0.446s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:30 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.info is being set with open permissions: ugo+rw Sep 23 00:28:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:30 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.info Sep 23 00:28:30 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:30 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.info" returned: 0 in 0.449s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.621s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.102s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-156754472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35523e3b-cc6d-4c14-b855-0267b8793d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab63c4e563c84401b2c25a015b4b233a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:27Z,use_quota=True,user_id='940b5fd71c324a03b365780f733a07e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02bda2bb-afce-4741-9fad-dc54e0abdb1c),volume_type_id=02bda2bb-afce-4741-9fad-dc54e0abdb1c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Creating volume 35523e3b-cc6d-4c14-b855-0267b8793d58 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:31 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:28:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-35523e3b-cc6d-4c14-b855-0267b8793d58 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:31 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-35523e3b-cc6d-4c14-b855-0267b8793d58 1073741824 Sep 23 00:28:31 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:31 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-74588d9d-33ac-4bfd-aeba-dc2f4d451aee tempest-CreateVolumesFromSnapshotTest-310064184 None] Create snapshot completed successfully Sep 23 00:28:31 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-35523e3b-cc6d-4c14-b855-0267b8793d58 1073741824" returned: 0 in 0.879s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-35523e3b-cc6d-4c14-b855-0267b8793d58 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:31 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-35523e3b-cc6d-4c14-b855-0267b8793d58 Sep 23 00:28:32 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:32 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-35523e3b-cc6d-4c14-b855-0267b8793d58" returned: 0 in 0.541s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b04956a-6a89-4a26-9b2e-bbffb03c90a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35523e3b-cc6d-4c14-b855-0267b8793d58', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e6d0ea-24e0-4f73-a748-4ab55930efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:32 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Volume volume-35523e3b-cc6d-4c14-b855-0267b8793d58 (35523e3b-cc6d-4c14-b855-0267b8793d58): created successfully Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e6d0ea-24e0-4f73-a748-4ab55930efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Flow 'volume_create_manager' (32c8cc2b-6c02-4e32-a9e2-be842a30b895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:32 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-55691eff-39b6-43b8-93dc-2dbc78e3d216 tempest-TestInstancesWithCinderVolumes-1269575785 None] Created volume successfully. Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Flow 'volume_create_manager' (d1a47b7e-9049-449e-ba3f-23efee588a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634e1783-c951-4159-988c-9f7972b95403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634e1783-c951-4159-988c-9f7972b95403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-394262154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6714422e-4507-4527-afba-d09706714216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2998b2724c934b5d9e6f2a9c2aa8b6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:33Z,use_quota=True,user_id='33145b7648894020adf5032d341d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6235aa1c-6163-4d93-bfbb-d890fdddbb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6235aa1c-6163-4d93-bfbb-d890fdddbb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2b50c1-fcbf-4241-8d64-cc1b3fa1fe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2b50c1-fcbf-4241-8d64-cc1b3fa1fe31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6714422e-4507-4527-afba-d09706714216', 'volume_name': 'volume-6714422e-4507-4527-afba-d09706714216', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e259668-62a7-443d-94cc-64b74d0e7342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e259668-62a7-443d-94cc-64b74d0e7342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfab1022-29f0-4ec2-ae12-2310c904fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:32 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume 6714422e-4507-4527-afba-d09706714216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6714422e-4507-4527-afba-d09706714216', 'volume_size': 1} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-394262154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6714422e-4507-4527-afba-d09706714216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2998b2724c934b5d9e6f2a9c2aa8b6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:33Z,use_quota=True,user_id='33145b7648894020adf5032d341d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Creating volume 6714422e-4507-4527-afba-d09706714216 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:32 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:28:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6714422e-4507-4527-afba-d09706714216 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:32 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6714422e-4507-4527-afba-d09706714216 1073741824 Sep 23 00:28:32 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Flow 'volume_create_manager' (edc4f213-2652-4487-9f80-a6262f387a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433697bf-58c8-45ec-8cf2-b9ea19ecb7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433697bf-58c8-45ec-8cf2-b9ea19ecb7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-17256693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5782563-a057-43fb-868d-1d397cb44c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2998b2724c934b5d9e6f2a9c2aa8b6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:33Z,use_quota=True,user_id='33145b7648894020adf5032d341d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9362f269-508c-43dc-a730-cbdc0e6df885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9362f269-508c-43dc-a730-cbdc0e6df885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0db781-6cbf-4fee-9e0d-c833a4cc33af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0db781-6cbf-4fee-9e0d-c833a4cc33af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5782563-a057-43fb-868d-1d397cb44c50', 'volume_name': 'volume-b5782563-a057-43fb-868d-1d397cb44c50', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34f1934-e32f-4cba-a987-acb7cda8a04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34f1934-e32f-4cba-a987-acb7cda8a04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211deaaf-6b34-4798-ba4f-82870b439225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:33 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume b5782563-a057-43fb-868d-1d397cb44c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5782563-a057-43fb-868d-1d397cb44c50', 'volume_size': 1} Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:33 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6714422e-4507-4527-afba-d09706714216 1073741824" returned: 0 in 0.803s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6714422e-4507-4527-afba-d09706714216 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:33 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6714422e-4507-4527-afba-d09706714216 Sep 23 00:28:33 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:34 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Flow 'volume_create_manager' (feb6a47b-c6ef-4153-ad7a-460fb32e124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124f8e02-0828-4357-8a73-36e1c8477df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6714422e-4507-4527-afba-d09706714216" returned: 0 in 0.579s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.726s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-17256693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5782563-a057-43fb-868d-1d397cb44c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2998b2724c934b5d9e6f2a9c2aa8b6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:33Z,use_quota=True,user_id='33145b7648894020adf5032d341d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Creating volume b5782563-a057-43fb-868d-1d397cb44c50 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:34 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b5782563-a057-43fb-868d-1d397cb44c50 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124f8e02-0828-4357-8a73-36e1c8477df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-703300420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e82719-c3f7-42af-9d00-f74c497db306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2998b2724c934b5d9e6f2a9c2aa8b6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:34Z,use_quota=True,user_id='33145b7648894020adf5032d341d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0144dbb4-7923-417c-b94c-b385dc0c1d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b5782563-a057-43fb-868d-1d397cb44c50 1073741824 Sep 23 00:28:34 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0144dbb4-7923-417c-b94c-b385dc0c1d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3858b968-ad6c-4729-81cf-7350f71e2e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3858b968-ad6c-4729-81cf-7350f71e2e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e82719-c3f7-42af-9d00-f74c497db306', 'volume_name': 'volume-99e82719-c3f7-42af-9d00-f74c497db306', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f09f187-ad04-40c8-8a9d-8284a1690796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f09f187-ad04-40c8-8a9d-8284a1690796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762d42e5-9e85-4dfc-a8d8-21721dbf3bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume 99e82719-c3f7-42af-9d00-f74c497db306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e82719-c3f7-42af-9d00-f74c497db306', 'volume_size': 1} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfab1022-29f0-4ec2-ae12-2310c904fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6714422e-4507-4527-afba-d09706714216', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe59139-a01a-4aaf-aa49-0d8ca1f5c1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD, size 20.69 MB, duration 5.79 sec {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:28:34 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Image download 20.69 MB at 3.57 MB/s Sep 23 00:28:34 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume volume-6714422e-4507-4527-afba-d09706714216 (6714422e-4507-4527-afba-d09706714216): created successfully Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe59139-a01a-4aaf-aa49-0d8ca1f5c1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Flow 'volume_create_manager' (d1a47b7e-9049-449e-ba3f-23efee588a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:34 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-63e32fd8-cbef-445e-a092-757fcd5f8611 tempest-CreateVolumesFromSnapshotTest-310064184 None] Created volume successfully. Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[73422308-2fbd-4ba4-9e0d-d8e9364a93ab]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:34 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD Sep 23 00:28:34 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Flow 'volume_create_manager' (e1f76505-ea5d-4384-9a21-ac55ccfc4aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faae7590-6cb3-4898-8163-4a4d84616f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faae7590-6cb3-4898-8163-4a4d84616f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1246041232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf06030-de36-4d9a-ac28-507bb1143d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2998b2724c934b5d9e6f2a9c2aa8b6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:35Z,use_quota=True,user_id='33145b7648894020adf5032d341d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0031ba00-8ccf-44fc-b1b2-05538575fdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0031ba00-8ccf-44fc-b1b2-05538575fdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cef9b5f-fd77-4f72-a5f3-522c85effcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cef9b5f-fd77-4f72-a5f3-522c85effcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf06030-de36-4d9a-ac28-507bb1143d98', 'volume_name': 'volume-8bf06030-de36-4d9a-ac28-507bb1143d98', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55685f05-e7a5-402e-9844-c553e02990e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55685f05-e7a5-402e-9844-c553e02990e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a45306-9355-4ce9-8ede-818737c0d920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume 8bf06030-de36-4d9a-ac28-507bb1143d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf06030-de36-4d9a-ac28-507bb1143d98', 'volume_size': 1} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:35 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b5782563-a057-43fb-868d-1d397cb44c50 1073741824" returned: 0 in 0.762s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b5782563-a057-43fb-868d-1d397cb44c50 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:35 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b5782563-a057-43fb-868d-1d397cb44c50 Sep 23 00:28:35 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:35 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD" returned: 0 in 0.701s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Temporary image dab109ce-d88d-40f7-b6e8-65cbb910e6d0 is fetched for user 940b5fd71c324a03b365780f733a07e9. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[3091c6dd-794d-41bd-b1ab-75b96174c746]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:35 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD Sep 23 00:28:35 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:35 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b5782563-a057-43fb-868d-1d397cb44c50" returned: 0 in 0.514s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.266s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-703300420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e82719-c3f7-42af-9d00-f74c497db306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2998b2724c934b5d9e6f2a9c2aa8b6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:34Z,use_quota=True,user_id='33145b7648894020adf5032d341d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Creating volume 99e82719-c3f7-42af-9d00-f74c497db306 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:35 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-99e82719-c3f7-42af-9d00-f74c497db306 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:35 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-99e82719-c3f7-42af-9d00-f74c497db306 1073741824 Sep 23 00:28:35 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211deaaf-6b34-4798-ba4f-82870b439225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5782563-a057-43fb-868d-1d397cb44c50', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4391d03-fb29-4b1d-a501-5d5a7aaf569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Flow 'volume_create_manager' (046f7aba-9c16-4485-ad6f-65388e414ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3c8eeb-7aae-44fa-b418-2e8f63ce5de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume volume-b5782563-a057-43fb-868d-1d397cb44c50 (b5782563-a057-43fb-868d-1d397cb44c50): created successfully Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4391d03-fb29-4b1d-a501-5d5a7aaf569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Flow 'volume_create_manager' (edc4f213-2652-4487-9f80-a6262f387a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3c8eeb-7aae-44fa-b418-2e8f63ce5de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-305948735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a57d2a7-db94-4f1b-8394-642bc1ceede8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2998b2724c934b5d9e6f2a9c2aa8b6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:36Z,use_quota=True,user_id='33145b7648894020adf5032d341d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f995290e-87d7-484b-bce9-49eb9c5668e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f995290e-87d7-484b-bce9-49eb9c5668e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e66236e-6411-41d2-a13a-e6ea77afc799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e66236e-6411-41d2-a13a-e6ea77afc799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a57d2a7-db94-4f1b-8394-642bc1ceede8', 'volume_name': 'volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aecb3be-fcad-4f84-a41c-407ef1989321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aecb3be-fcad-4f84-a41c-407ef1989321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b249d8f6-146e-46a0-9016-b4739db13fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:35 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume 7a57d2a7-db94-4f1b-8394-642bc1ceede8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8', 'volume_size': 1} Sep 23 00:28:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD" returned: 0 in 0.612s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:36 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9856ec3d-5f6b-4d90-bbaa-49093de3d765 tempest-CreateVolumesFromSnapshotTest-310064184 None] Created volume successfully. Sep 23 00:28:36 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-99e82719-c3f7-42af-9d00-f74c497db306 1073741824" returned: 0 in 0.703s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-99e82719-c3f7-42af-9d00-f74c497db306 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:36 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-99e82719-c3f7-42af-9d00-f74c497db306 Sep 23 00:28:36 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:36 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-99e82719-c3f7-42af-9d00-f74c497db306" returned: 0 in 0.341s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.725s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1246041232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf06030-de36-4d9a-ac28-507bb1143d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2998b2724c934b5d9e6f2a9c2aa8b6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:35Z,use_quota=True,user_id='33145b7648894020adf5032d341d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Creating volume 8bf06030-de36-4d9a-ac28-507bb1143d98 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:36 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8bf06030-de36-4d9a-ac28-507bb1143d98 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762d42e5-9e85-4dfc-a8d8-21721dbf3bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e82719-c3f7-42af-9d00-f74c497db306', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:36 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8bf06030-de36-4d9a-ac28-507bb1143d98 1073741824 Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00d92d5-58d7-4739-b8cf-6d29759ae2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:36 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:36 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume volume-99e82719-c3f7-42af-9d00-f74c497db306 (99e82719-c3f7-42af-9d00-f74c497db306): created successfully Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00d92d5-58d7-4739-b8cf-6d29759ae2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Flow 'volume_create_manager' (feb6a47b-c6ef-4153-ad7a-460fb32e124e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:36 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-358fb6f0-8121-4793-9ebf-d50246c0a3e3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Created volume successfully. Sep 23 00:28:37 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8bf06030-de36-4d9a-ac28-507bb1143d98 1073741824" returned: 0 in 0.662s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8bf06030-de36-4d9a-ac28-507bb1143d98 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:37 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8bf06030-de36-4d9a-ac28-507bb1143d98 Sep 23 00:28:37 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Flow 'volume_create_manager' (d2668047-adbe-424a-9248-0a9c289ccd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a656ba54-2c13-4892-9699-8e71f31270c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a656ba54-2c13-4892-9699-8e71f31270c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1084835521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e484561-a8fd-4d85-805e-13cd35d9f1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c74a454cd034e318049e9d4f55007af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:37Z,use_quota=True,user_id='a1738befafce4854912fe1eb47fbd3aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df290e79-88d4-4d57-ab33-ad028ac68212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df290e79-88d4-4d57-ab33-ad028ac68212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e35885d-fa64-46cb-bb45-45d793c0e991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e35885d-fa64-46cb-bb45-45d793c0e991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e484561-a8fd-4d85-805e-13cd35d9f1f3', 'volume_name': 'volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caddbe7b-b563-4a5c-8696-8aaaebac5a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caddbe7b-b563-4a5c-8696-8aaaebac5a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f7b567-e87c-4ac2-86b9-b55b2a03cdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:37 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Volume 0e484561-a8fd-4d85-805e-13cd35d9f1f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3', 'volume_size': 1} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:37 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8bf06030-de36-4d9a-ac28-507bb1143d98" returned: 0 in 0.322s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.857s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-305948735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a57d2a7-db94-4f1b-8394-642bc1ceede8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2998b2724c934b5d9e6f2a9c2aa8b6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:36Z,use_quota=True,user_id='33145b7648894020adf5032d341d484c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Creating volume 7a57d2a7-db94-4f1b-8394-642bc1ceede8 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:37 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a45306-9355-4ce9-8ede-818737c0d920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf06030-de36-4d9a-ac28-507bb1143d98', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdd8b97-334a-4963-8d8e-20fc447a2c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:37 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8 1073741824 Sep 23 00:28:37 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:37 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume volume-8bf06030-de36-4d9a-ac28-507bb1143d98 (8bf06030-de36-4d9a-ac28-507bb1143d98): created successfully Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdd8b97-334a-4963-8d8e-20fc447a2c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Flow 'volume_create_manager' (e1f76505-ea5d-4384-9a21-ac55ccfc4aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-54c5bc25-216e-4c60-b5f4-02530e1688d6 tempest-CreateVolumesFromSnapshotTest-310064184 None] Created volume successfully. Sep 23 00:28:38 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8 1073741824" returned: 0 in 0.683s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8 Sep 23 00:28:38 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:38 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8" returned: 0 in 0.361s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.968s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1087985965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6d34ff-a91d-4cf7-94a0-078b93257fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab63c4e563c84401b2c25a015b4b233a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:28Z,use_quota=True,user_id='940b5fd71c324a03b365780f733a07e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28b9ee2d-078c-4e1b-a63d-b7bc5cc86def),volume_type_id=28b9ee2d-078c-4e1b-a63d-b7bc5cc86def)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Creating volume cf6d34ff-a91d-4cf7-94a0-078b93257fb8 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:38 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:28:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b249d8f6-146e-46a0-9016-b4739db13fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:39 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 1073741824 Sep 23 00:28:39 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d4e35d-c363-44c5-83cc-f6eb59b4b248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:39 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Volume volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8 (7a57d2a7-db94-4f1b-8394-642bc1ceede8): created successfully Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89d4e35d-c363-44c5-83cc-f6eb59b4b248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Flow 'volume_create_manager' (046f7aba-9c16-4485-ad6f-65388e414ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:39 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2940a860-dae9-46c6-8365-28fb874e2384 tempest-CreateVolumesFromSnapshotTest-310064184 None] Created volume successfully. Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-7a57d2a7-db94-4f1b-8394-642bc1ceede8-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-7a57d2a7-db94-4f1b-8394-642bc1ceede8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-quobyte-7a57d2a7-db94-4f1b-8394-642bc1ceede8" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-7a57d2a7-db94-4f1b-8394-642bc1ceede8" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c517e5a-11aa-4615-9d96-f4dccecd53ce]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8 Sep 23 00:28:39 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 1073741824" returned: 0 in 0.766s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:39 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 Sep 23 00:28:39 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8" returned: 0 in 0.535s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8 Sep 23 00:28:40 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8" returned: 0 in 0.368s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.590s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1084835521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e484561-a8fd-4d85-805e-13cd35d9f1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c74a454cd034e318049e9d4f55007af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:37Z,use_quota=True,user_id='a1738befafce4854912fe1eb47fbd3aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Creating volume 0e484561-a8fd-4d85-805e-13cd35d9f1f3 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:40 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 1073741824 Sep 23 00:28:40 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Attempting download of dab109ce-d88d-40f7-b6e8-65cbb910e6d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'metadata': {}}])) to volume cf6d34ff-a91d-4cf7-94a0-078b93257fb8. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a514a4-de9d-4847-9b33-9488c589ea59]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_v70urrag {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7a57d2a7-db94-4f1b-8394-642bc1ceede8" returned: 0 in 0.548s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-7a57d2a7-db94-4f1b-8394-642bc1ceede8" released by "delete_volume" :: held 1.183s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Created reservations ['68d91080-1fbd-496b-8a31-6c4ffadc50e2', 'dbb4466c-d7bc-40af-9dff-b44f2864db24', 'fa448334-37f9-4cb8-ae78-50f47a91826b', '60857336-ea42-4a72-bb71-c9fe8852c01f'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:40 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_v70urrag Sep 23 00:28:40 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:40 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:28:40 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:41 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_v70urrag" returned: 0 in 0.658s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_v70urrag {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:41 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 1073741824" returned: 0 in 0.951s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_v70urrag Sep 23 00:28:41 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:41 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 Sep 23 00:28:41 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:41 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.705s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:41 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Deleted volume successfully. Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-54f2be18-3d7c-496c-946c-747476a4ef33 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-7a57d2a7-db94-4f1b-8394-642bc1ceede8-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:41 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_v70urrag" returned: 1 in 0.546s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_v70urrag' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[071e9397-b8a8-418e-9671-fa6f2d1c59ef]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:41 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3" returned: 0 in 0.401s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f7b567-e87c-4ac2-86b9-b55b2a03cdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4909d2-b80f-4680-8f09-505dccf7b7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-8bf06030-de36-4d9a-ac28-507bb1143d98-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:41 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Volume volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 (0e484561-a8fd-4d85-805e-13cd35d9f1f3): created successfully Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4909d2-b80f-4680-8f09-505dccf7b7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Flow 'volume_create_manager' (d2668047-adbe-424a-9248-0a9c289ccd9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:41 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD Sep 23 00:28:41 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-8bf06030-de36-4d9a-ac28-507bb1143d98-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:41 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b44b86c7-e9ac-460e-984e-02302dcb02e5 tempest-TestStampPattern-1454202446 None] Created volume successfully. Sep 23 00:28:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-quobyte-8bf06030-de36-4d9a-ac28-507bb1143d98" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-8bf06030-de36-4d9a-ac28-507bb1143d98" acquired by "delete_volume" :: waited 0.034s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:42 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff90f9ad-e1fe-4ec6-a3c5-7ce5018a360d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8bf06030-de36-4d9a-ac28-507bb1143d98 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:42 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD" returned: 0 in 0.527s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:42 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] dab109ce-d88d-40f7-b6e8-65cbb910e6d0 was qcow2, converting to qcow2 {{(pid=86481) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:28:42 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8bf06030-de36-4d9a-ac28-507bb1143d98 Sep 23 00:28:42 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:42 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 Sep 23 00:28:42 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:42 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8bf06030-de36-4d9a-ac28-507bb1143d98" returned: 0 in 0.684s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8bf06030-de36-4d9a-ac28-507bb1143d98 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:42 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8bf06030-de36-4d9a-ac28-507bb1143d98 Sep 23 00:28:42 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:43 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8bf06030-de36-4d9a-ac28-507bb1143d98" returned: 0 in 0.307s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-8bf06030-de36-4d9a-ac28-507bb1143d98" released by "delete_volume" :: held 1.057s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:43 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Created reservations ['79698938-fea3-4b2c-8eae-747a3ab6eea3', 'cc0e11c0-8612-41f7-9ccf-aad944930090', '6a6ef8e2-0866-4366-81d4-0cd50bc69b4d', 'ad016ba1-350a-4a8c-80e7-7fd4f0a18778'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:43 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:28:43 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:43 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.353s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:43 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:43 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Deleted volume successfully. Sep 23 00:28:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-29ae9545-c9bf-4172-8db7-b14ec482e6ef tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-8bf06030-de36-4d9a-ac28-507bb1143d98-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-99e82719-c3f7-42af-9d00-f74c497db306-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-99e82719-c3f7-42af-9d00-f74c497db306-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-quobyte-99e82719-c3f7-42af-9d00-f74c497db306" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-99e82719-c3f7-42af-9d00-f74c497db306" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:44 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8151ab7-cd52-4490-a3d6-3701ad960749]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-99e82719-c3f7-42af-9d00-f74c497db306 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:44 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-99e82719-c3f7-42af-9d00-f74c497db306 Sep 23 00:28:44 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:28:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:45 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8" returned: 0 in 2.785s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dab109ce-d88d-40f7-b6e8-65cbb910e6d0_697r9jtvdevstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:28:45 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Converted 112.00 MB image at 40.18 MB/s Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:45 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:28:45 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:45 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-99e82719-c3f7-42af-9d00-f74c497db306" returned: 0 in 0.628s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-99e82719-c3f7-42af-9d00-f74c497db306 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:45 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 1G Sep 23 00:28:45 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:45 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-99e82719-c3f7-42af-9d00-f74c497db306 Sep 23 00:28:45 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:45 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-99e82719-c3f7-42af-9d00-f74c497db306" returned: 0 in 0.577s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-99e82719-c3f7-42af-9d00-f74c497db306" released by "delete_volume" :: held 1.306s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:45 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.887s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Created reservations ['433bd189-d057-4784-bbf7-97eb28235e51', 'b7118dec-76a1-45d3-b7f3-76ae84175646', 'a108d54e-de09-41d7-bcb9-123ee9154d2a', 'a1062d13-6465-4b2d-b0f3-e61d0ee896b9'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:45 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 1G" returned: 0 in 0.968s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:45 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Downloaded image dab109ce-d88d-40f7-b6e8-65cbb910e6d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'metadata': {}}])) to volume cf6d34ff-a91d-4cf7-94a0-078b93257fb8 successfully. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Temporary image dab109ce-d88d-40f7-b6e8-65cbb910e6d0 for user 940b5fd71c324a03b365780f733a07e9 is deleted. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Marking volume cf6d34ff-a91d-4cf7-94a0-078b93257fb8 as bootable. {{(pid=86481) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Copying metadata from image dab109ce-d88d-40f7-b6e8-65cbb910e6d0 to cf6d34ff-a91d-4cf7-94a0-078b93257fb8. {{(pid=86481) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Creating volume glance metadata for volume cf6d34ff-a91d-4cf7-94a0-078b93257fb8 backed by image dab109ce-d88d-40f7-b6e8-65cbb910e6d0 with: {'image_id': 'dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'image_name': 'tempest-scenario-img--207916021', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86481) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8d3ea4-5151-46d2-bf9a-9a563ea906b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8', 'volume_size': 1, 'image_id': 'dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--207916021', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ab63c4e563c84401b2c25a015b4b233a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'dab109ce-d88d-40f7-b6e8-65cbb910e6d0', 'created_at': datetime.datetime(2026, 9, 22, 22, 28, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 28, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dab109ce-d88d-40f7-b6e8-65cbb910e6d0/file', 'properties': {}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af518c1-5618-457d-a153-15a646485a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:46 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Volume volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 (cf6d34ff-a91d-4cf7-94a0-078b93257fb8): created successfully Sep 23 00:28:46 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af518c1-5618-457d-a153-15a646485a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Flow 'volume_create_manager' (96de34f8-f8c8-4341-8f85-09d994be53ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:46 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:46 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-972c2c69-5441-4819-a696-31971a2d9bae tempest-TestInstancesWithCinderVolumes-1269575785 None] Created volume successfully. Sep 23 00:28:46 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.360s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:46 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Deleted volume successfully. Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-95f82f2c-0aa0-41f5-a80d-365e96232ad3 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-99e82719-c3f7-42af-9d00-f74c497db306-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-b5782563-a057-43fb-868d-1d397cb44c50-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-b5782563-a057-43fb-868d-1d397cb44c50-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-quobyte-b5782563-a057-43fb-868d-1d397cb44c50" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-b5782563-a057-43fb-868d-1d397cb44c50" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aadec9c-d232-4d1b-994c-3dbdd8aaab7d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b5782563-a057-43fb-868d-1d397cb44c50 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:47 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b5782563-a057-43fb-868d-1d397cb44c50 Sep 23 00:28:47 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:47 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b5782563-a057-43fb-868d-1d397cb44c50" returned: 0 in 0.732s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b5782563-a057-43fb-868d-1d397cb44c50 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:47 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b5782563-a057-43fb-868d-1d397cb44c50 Sep 23 00:28:47 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:47 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b5782563-a057-43fb-868d-1d397cb44c50" returned: 0 in 0.370s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-b5782563-a057-43fb-868d-1d397cb44c50" released by "delete_volume" :: held 1.165s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:48 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Created reservations ['247440c9-de72-4903-bedf-54bdc535c8a4', '7210056e-a366-40f1-94e6-c148b51db4c0', '60bd0cac-a673-404c-aa35-625018bb20d3', 'b097fccf-2ec7-4d11-837b-6cff52c222d2'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:48 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:28:48 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:48 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.345s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:48 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Deleted volume successfully. Sep 23 00:28:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fc42403d-fd0f-4a34-97b4-94729c1c6454 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-b5782563-a057-43fb-868d-1d397cb44c50-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-6714422e-4507-4527-afba-d09706714216-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-6714422e-4507-4527-afba-d09706714216-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-quobyte-6714422e-4507-4527-afba-d09706714216" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-6714422e-4507-4527-afba-d09706714216" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:49 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[778cad85-713f-434a-bddc-6cb103a430d8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6714422e-4507-4527-afba-d09706714216 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:49 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6714422e-4507-4527-afba-d09706714216 Sep 23 00:28:49 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:50 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6714422e-4507-4527-afba-d09706714216" returned: 0 in 0.793s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6714422e-4507-4527-afba-d09706714216 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:50 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6714422e-4507-4527-afba-d09706714216 Sep 23 00:28:50 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:50 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6714422e-4507-4527-afba-d09706714216" returned: 0 in 0.601s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-6714422e-4507-4527-afba-d09706714216" released by "delete_volume" :: held 1.491s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:50 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=123,cinder:DELETE=12,cinder:SELECT=78,cinder:INSERT=31 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:50 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Created reservations ['0086e8d8-9d76-410f-8592-6afbbd2ef4cc', '02e6d3c1-1109-467f-a944-dc9c7766e248', 'dcafcf9b-8d9f-4f00-9f3b-036a22d52ba7', '5b214896-63cd-44dc-b8bc-a3f66d38539a'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:51 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:28:51 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-1deb95c8-5cc2-4646-a524-cf3edea18836-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:51 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.582s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:51 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Deleted volume successfully. Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-1deb95c8-5cc2-4646-a524-cf3edea18836-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-quobyte-63bce97c-1ff9-4340-a40f-23bb16bc9a10" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-63bce97c-1ff9-4340-a40f-23bb16bc9a10" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-quobyte-1deb95c8-5cc2-4646-a524-cf3edea18836" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b2f7a5c2-0080-411f-8198-fe4dd3d5aec8 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-6714422e-4507-4527-afba-d09706714216-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-1deb95c8-5cc2-4646-a524-cf3edea18836" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Deleting offline snapshot 1deb95c8-5cc2-4646-a524-cf3edea18836 of volume 63bce97c-1ff9-4340-a40f-23bb16bc9a10 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] snapshot_file for this snap is: volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1064cd-deaa-404f-96b5-989e4d7d3f0d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:52 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=107,cinder:INSERT=44,cinder:UPDATE=119,cinder:DELETE=12 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-ce53cd99-410a-4080-b511-cd9ea3d2ee67 req-40a4ddf3-fc5a-4e8e-8575-cc8e00b26eef tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-ce53cd99-410a-4080-b511-cd9ea3d2ee67 req-40a4ddf3-fc5a-4e8e-8575-cc8e00b26eef tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-ce53cd99-410a-4080-b511-cd9ea3d2ee67 req-40a4ddf3-fc5a-4e8e-8575-cc8e00b26eef tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-ce53cd99-410a-4080-b511-cd9ea3d2ee67 req-40a4ddf3-fc5a-4e8e-8575-cc8e00b26eef tempest-TestInstancesWithCinderVolumes-1269575785 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cbc9a43-01b2-4411-a167-61b1dc757e74', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:28:52 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 Sep 23 00:28:52 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:52 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-ce53cd99-410a-4080-b511-cd9ea3d2ee67 req-40a4ddf3-fc5a-4e8e-8575-cc8e00b26eef tempest-TestInstancesWithCinderVolumes-1269575785 None] attachment_update completed successfully. Sep 23 00:28:52 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836" returned: 0 in 0.798s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:28:52 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cb5012-9ecb-47be-9705-6fa6864d0370]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:53 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 Sep 23 00:28:53 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:53 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10" returned: 0 in 0.629s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:53 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 Sep 23 00:28:53 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:54 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836" returned: 0 in 0.562s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:54 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836 Sep 23 00:28:54 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:54 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10.1deb95c8-5cc2-4646-a524-cf3edea18836" returned: 0 in 0.389s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-1deb95c8-5cc2-4646-a524-cf3edea18836" released by "_delete_snapshot" :: held 2.672s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-63bce97c-1ff9-4340-a40f-23bb16bc9a10" released by "delete_snapshot" :: held 2.743s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:54 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Created reservations ['30bd9a7a-0faf-4f8a-a641-bbc215285603', '00e88f8a-347c-4a2d-8470-c7a202e1356f', '0c57a240-3c41-457a-81d5-91c5be87f91d', '4ff85542-bce6-4ec1-85c6-e7a07ebb5810'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:54 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Delete snapshot completed successfully. Sep 23 00:28:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-905c6b69-4a28-4cfb-9040-72d39ecc4110 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-1deb95c8-5cc2-4646-a524-cf3edea18836-delete_snapshot" released by "delete_snapshot" :: held 3.051s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-63bce97c-1ff9-4340-a40f-23bb16bc9a10-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-63bce97c-1ff9-4340-a40f-23bb16bc9a10-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "cinder-quobyte-63bce97c-1ff9-4340-a40f-23bb16bc9a10" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-63bce97c-1ff9-4340-a40f-23bb16bc9a10" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:55 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9658e6ff-25a9-4bf3-b5d7-584a97ffc49f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:55 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 Sep 23 00:28:55 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:56 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10" returned: 0 in 0.657s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:56 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10 Sep 23 00:28:56 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:56 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-63bce97c-1ff9-4340-a40f-23bb16bc9a10" returned: 0 in 0.844s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-quobyte-63bce97c-1ff9-4340-a40f-23bb16bc9a10" released by "delete_volume" :: held 1.678s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:57 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Created reservations ['2fdec01a-05b9-4690-ba33-26cea66251e0', '8d8562d4-276f-4f8b-b61b-c06a85521249', '31568243-1389-4eeb-8935-46666b6a95d8', '81126ff0-0581-4db4-a6ba-4c15b97d7665'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:28:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:57 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:28:57 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:58 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.696s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:58 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:58 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Deleted volume successfully. Sep 23 00:28:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b6298f26-3b84-4958-8615-b34955570fe4 tempest-CreateVolumesFromSnapshotTest-310064184 None] Lock "cinder-63bce97c-1ff9-4340-a40f-23bb16bc9a10-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Flow 'volume_create_manager' (44d45010-13ac-45ce-bb36-767c03893340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5dde316-daae-4fbb-bf24-25250a0190a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5dde316-daae-4fbb-bf24-25250a0190a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-872547424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84091144-267d-4bd7-9e10-f0fc0c7cd714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9acf841a8545849100aba1ce1d998d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:05Z,use_quota=True,user_id='d70d81118ae24c7eb8f2dc1575f175f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6690535-4b66-4ae2-bd37-3fffa9017e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6690535-4b66-4ae2-bd37-3fffa9017e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153ea761-e1a4-47e1-a5e7-65a8b1d18efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153ea761-e1a4-47e1-a5e7-65a8b1d18efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84091144-267d-4bd7-9e10-f0fc0c7cd714', 'volume_name': 'volume-84091144-267d-4bd7-9e10-f0fc0c7cd714', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca641db-6ce3-491d-aee0-2fc7707f4c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca641db-6ce3-491d-aee0-2fc7707f4c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94cf6b34-8441-4f37-852b-ff04de3fef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:05 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Volume 84091144-267d-4bd7-9e10-f0fc0c7cd714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84091144-267d-4bd7-9e10-f0fc0c7cd714', 'volume_size': 1} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-872547424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84091144-267d-4bd7-9e10-f0fc0c7cd714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9acf841a8545849100aba1ce1d998d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:05Z,use_quota=True,user_id='d70d81118ae24c7eb8f2dc1575f175f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Creating volume 84091144-267d-4bd7-9e10-f0fc0c7cd714 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:05 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:29:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-84091144-267d-4bd7-9e10-f0fc0c7cd714 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:05 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-84091144-267d-4bd7-9e10-f0fc0c7cd714 1073741824 Sep 23 00:29:05 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:06 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-84091144-267d-4bd7-9e10-f0fc0c7cd714 1073741824" returned: 0 in 0.870s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-84091144-267d-4bd7-9e10-f0fc0c7cd714 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:06 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-84091144-267d-4bd7-9e10-f0fc0c7cd714 Sep 23 00:29:06 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:07 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-84091144-267d-4bd7-9e10-f0fc0c7cd714" returned: 0 in 0.415s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94cf6b34-8441-4f37-852b-ff04de3fef81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84091144-267d-4bd7-9e10-f0fc0c7cd714', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515b4f65-d8c6-4e63-9634-80394b05325a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:07 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Volume volume-84091144-267d-4bd7-9e10-f0fc0c7cd714 (84091144-267d-4bd7-9e10-f0fc0c7cd714): created successfully Sep 23 00:29:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515b4f65-d8c6-4e63-9634-80394b05325a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Flow 'volume_create_manager' (44d45010-13ac-45ce-bb36-767c03893340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:07 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e682735a-9b6a-4aef-8ce7-e7c9ab9796f4 tempest-ProjectReaderTests-441040683 None] Created volume successfully. Sep 23 00:29:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Acquiring lock "cinder-84091144-267d-4bd7-9e10-f0fc0c7cd714-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Lock "cinder-84091144-267d-4bd7-9e10-f0fc0c7cd714-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Acquiring lock "cinder-quobyte-84091144-267d-4bd7-9e10-f0fc0c7cd714" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Lock "cinder-quobyte-84091144-267d-4bd7-9e10-f0fc0c7cd714" acquired by "delete_volume" :: waited 0.018s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:08 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b361805-c16c-41a8-9791-ee3973ae0c0c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-84091144-267d-4bd7-9e10-f0fc0c7cd714 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:08 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-84091144-267d-4bd7-9e10-f0fc0c7cd714 Sep 23 00:29:08 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:08 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-84091144-267d-4bd7-9e10-f0fc0c7cd714" returned: 0 in 0.555s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-84091144-267d-4bd7-9e10-f0fc0c7cd714 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:08 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-84091144-267d-4bd7-9e10-f0fc0c7cd714 Sep 23 00:29:08 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:09 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-84091144-267d-4bd7-9e10-f0fc0c7cd714" returned: 0 in 0.370s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:09 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Lock "cinder-quobyte-84091144-267d-4bd7-9e10-f0fc0c7cd714" released by "delete_volume" :: held 1.040s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:09 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Created reservations ['81589fa0-ab5e-462b-b733-abc7684b62a7', 'fa39bf1f-5182-4d37-aeca-e6e26b084eb7', '95d72fe2-ddba-4594-94e2-946f74f2ef2b', 'de019fd0-7823-4f14-9e5c-b52ece6c419c'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:09 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:29:09 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:10 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.869s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:10 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Deleted volume successfully. Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-051bbc75-d663-41e1-b716-aa2f98040fd0 tempest-ProjectReaderTests-441040683 None] Lock "cinder-84091144-267d-4bd7-9e10-f0fc0c7cd714-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Flow 'volume_create_manager' (85cfb4b8-b728-4a6f-b2ee-f4cfc02820c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87531961-121a-4caa-9916-d40282407820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87531961-121a-4caa-9916-d40282407820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006951144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8609f4e3-eb32-4e9b-9b10-f0e7930a8c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9acf841a8545849100aba1ce1d998d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:10Z,use_quota=True,user_id='d70d81118ae24c7eb8f2dc1575f175f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da41b10-8808-4104-bd24-666b71eaff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da41b10-8808-4104-bd24-666b71eaff7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af295cd-6a61-4bea-8c16-7c94d5cf5849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af295cd-6a61-4bea-8c16-7c94d5cf5849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8609f4e3-eb32-4e9b-9b10-f0e7930a8c62', 'volume_name': 'volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e274de6-06f6-4839-ae06-064d9531f7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e274de6-06f6-4839-ae06-064d9531f7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b5eca4-2347-42d7-9d2f-1766dd414b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:10 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Volume 8609f4e3-eb32-4e9b-9b10-f0e7930a8c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62', 'volume_size': 1} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006951144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8609f4e3-eb32-4e9b-9b10-f0e7930a8c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9acf841a8545849100aba1ce1d998d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:10Z,use_quota=True,user_id='d70d81118ae24c7eb8f2dc1575f175f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Creating volume 8609f4e3-eb32-4e9b-9b10-f0e7930a8c62 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:10 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:29:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:10 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62 1073741824 Sep 23 00:29:10 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:11 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62 1073741824" returned: 0 in 0.783s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:11 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62 Sep 23 00:29:11 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:11 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62" returned: 0 in 0.419s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b5eca4-2347-42d7-9d2f-1766dd414b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311bdd6b-3e27-4a2a-be32-3400f1947ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:12 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Volume volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62 (8609f4e3-eb32-4e9b-9b10-f0e7930a8c62): created successfully Sep 23 00:29:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311bdd6b-3e27-4a2a-be32-3400f1947ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Flow 'volume_create_manager' (85cfb4b8-b728-4a6f-b2ee-f4cfc02820c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:12 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-66697e50-bf34-4ca3-85b6-87079833fc44 tempest-ProjectReaderTests-441040683 None] Created volume successfully. Sep 23 00:29:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Acquiring lock "cinder-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Lock "cinder-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Acquiring lock "cinder-quobyte-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Lock "cinder-quobyte-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:12 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e109aaa-11b6-46c2-9dc8-02f9a4669ee3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:12 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62 Sep 23 00:29:12 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:13 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62" returned: 0 in 0.462s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:13 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62 Sep 23 00:29:13 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:13 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62" returned: 0 in 0.313s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Lock "cinder-quobyte-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62" released by "delete_volume" :: held 0.833s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:13 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Created reservations ['5ac56bac-84cf-4bd1-bcb6-a31f480b1dbd', 'cfc3b531-a406-4e23-90ce-bb576e14906a', 'd3f3a72d-997e-4747-bbf0-b43836623f1c', '4d3178d5-5ffa-43d7-bbea-61578d0cac0f'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:13 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:29:13 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:14 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.368s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:14 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:14 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Deleted volume successfully. Sep 23 00:29:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-0ac53fef-7713-4341-b9c0-48fc9a9dc4a5 tempest-ProjectReaderTests-441040683 None] Lock "cinder-8609f4e3-eb32-4e9b-9b10-f0e7930a8c62-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-d0789b80-e1e0-4ddb-a319-b7aa243a8c83 req-208e6659-1076-4115-86ac-84933fba0f49 tempest-TestStampPattern-1454202446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-d0789b80-e1e0-4ddb-a319-b7aa243a8c83 req-208e6659-1076-4115-86ac-84933fba0f49 tempest-TestStampPattern-1454202446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-d0789b80-e1e0-4ddb-a319-b7aa243a8c83 req-208e6659-1076-4115-86ac-84933fba0f49 tempest-TestStampPattern-1454202446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-d0789b80-e1e0-4ddb-a319-b7aa243a8c83 req-208e6659-1076-4115-86ac-84933fba0f49 tempest-TestStampPattern-1454202446 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9dbb8f82-632b-4eb0-9297-63641104a852', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:29:15 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-d0789b80-e1e0-4ddb-a319-b7aa243a8c83 req-208e6659-1076-4115-86ac-84933fba0f49 tempest-TestStampPattern-1454202446 None] attachment_update completed successfully. Sep 23 00:29:22 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-c1d20c09-622c-4b80-bc81-d59501ffbd82 req-f61ceeba-e7cf-4aa2-848b-05ac2939a8fa tempest-TestStampPattern-1454202446 None] Terminate volume connection completed successfully. Sep 23 00:29:22 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-c1d20c09-622c-4b80-bc81-d59501ffbd82 req-f61ceeba-e7cf-4aa2-848b-05ac2939a8fa tempest-TestStampPattern-1454202446 None] Deleting attachment 9dbb8f82-632b-4eb0-9297-63641104a852. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:29:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] Creating offline snapshot c2991060-508f-4495-8784-fb974cddc542 of volume 0e484561-a8fd-4d85-805e-13cd35d9f1f3 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:23 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eddba76-66e6-4825-976b-b29d90f2f7b0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:23 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 Sep 23 00:29:23 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:23 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3" returned: 0 in 0.448s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:23 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 1G Sep 23 00:29:23 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:24 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 1G" returned: 0 in 0.469s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:24 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 Sep 23 00:29:24 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:24 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542" returned: 0 in 0.320s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:24 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 is being set with open permissions: ugo+rw Sep 23 00:29:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:24 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 Sep 23 00:29:24 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:24 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542" returned: 0 in 0.293s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:24 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.info Sep 23 00:29:24 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:25 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.info" returned: 0 in 0.294s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:25 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.info is being set with open permissions: ugo+rw Sep 23 00:29:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:25 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.info Sep 23 00:29:25 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:25 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.info" returned: 0 in 0.265s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:25 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3abd0a1d-72b3-4dc4-bf62-8790859e7f7e tempest-TestStampPattern-1454202446 None] Create snapshot completed successfully Sep 23 00:29:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-44ac3546-6e8d-4bf7-a93d-028fbbfbfaf2 req-17d6890e-8a37-415e-aa09-b84bfe64e162 tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-44ac3546-6e8d-4bf7-a93d-028fbbfbfaf2 req-17d6890e-8a37-415e-aa09-b84bfe64e162 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-44ac3546-6e8d-4bf7-a93d-028fbbfbfaf2 req-17d6890e-8a37-415e-aa09-b84bfe64e162 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-44ac3546-6e8d-4bf7-a93d-028fbbfbfaf2 req-17d6890e-8a37-415e-aa09-b84bfe64e162 tempest-TestInstancesWithCinderVolumes-1269575785 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-aa954feb-1f28-486c-9c25-c345921ad673', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cb842d6-535a-477f-ae72-03bfb4573f7a', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:29:32 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-44ac3546-6e8d-4bf7-a93d-028fbbfbfaf2 req-17d6890e-8a37-415e-aa09-b84bfe64e162 tempest-TestInstancesWithCinderVolumes-1269575785 None] attachment_update completed successfully. Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Flow 'volume_create_manager' (f65694b9-eb0d-4112-922b-417241ecc56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5331c6d5-08bb-4575-86ab-b9a63760eae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5331c6d5-08bb-4575-86ab-b9a63760eae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1394990399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33d2abc-5e7b-4ef9-865a-fc58ae9109ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c74a454cd034e318049e9d4f55007af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c2991060-508f-4495-8784-fb974cddc542,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:35Z,use_quota=True,user_id='a1738befafce4854912fe1eb47fbd3aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f39d14-8aba-4342-bc83-aebf9e8936d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f39d14-8aba-4342-bc83-aebf9e8936d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cb3c14-2999-45b0-bd59-7a094ddde1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cb3c14-2999-45b0-bd59-7a094ddde1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b33d2abc-5e7b-4ef9-865a-fc58ae9109ca', 'volume_name': 'volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca', 'volume_size': 1, 'snapshot_id': 'c2991060-508f-4495-8784-fb974cddc542'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f0cfa8-ed42-4ceb-8504-002e931a55a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f0cfa8-ed42-4ceb-8504-002e931a55a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae9c60b-8372-46a3-be3a-ca832bc33cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:34 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Volume b33d2abc-5e7b-4ef9-865a-fc58ae9109ca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca', 'volume_size': 1, 'snapshot_id': 'c2991060-508f-4495-8784-fb974cddc542'} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Acquiring lock "cinder-quobyte-c2991060-508f-4495-8784-fb974cddc542-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" by "_create_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Lock "cinder-quobyte-c2991060-508f-4495-8784-fb974cddc542-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Creating volume b33d2abc-5e7b-4ef9-865a-fc58ae9109ca from snapshot c2991060-508f-4495-8784-fb974cddc542 {{(pid=86481) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Acquiring lock "cinder-quobyte-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" by "_copy_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Lock "cinder-quobyte-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] snapshot: c2991060-508f-4495-8784-fb974cddc542, volume: b33d2abc-5e7b-4ef9-865a-fc58ae9109ca, {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e62723f-13b6-4048-9164-408ea31055a8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:35 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 Sep 23 00:29:35 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:35 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542" returned: 0 in 0.560s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:35 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fade51-f1da-4be5-9ad6-1922dba7dcb5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:35 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 Sep 23 00:29:35 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-8dfbc837-4437-4210-b788-08a39a11cf4a req-ae577314-ea45-4339-a8e2-417bec94f556 tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:36 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3" returned: 0 in 0.577s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:29:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Creating direct copy from snapshot {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:29:36 devstack cinder-volume[86481]: DEBUG cinder.utils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Path /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca not found in is_blk_device check {{(pid=86481) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:29:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:36 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca Sep 23 00:29:36 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:29:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:45 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:29:45 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:45 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.915s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:45 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" returned: 0 in 9.777s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3, size 1024.00 MB, duration 9.78 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:29:45 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Converted 1024.00 MB image at 104.72 MB/s Sep 23 00:29:45 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca is being set with open permissions: ugo+rw Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=52,cinder:UPDATE=47,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:29:45 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:INSERT=8,cinder:UPDATE=44,cinder:DELETE=4,cinder:SELECT=51 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:45 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca Sep 23 00:29:45 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:46 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" returned: 0 in 0.434s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Lock "cinder-quobyte-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" released by "_copy_volume_from_snapshot" :: held 11.485s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Lock "cinder-quobyte-c2991060-508f-4495-8784-fb974cddc542-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" released by "_create_volume_from_snapshot" :: held 11.576s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.595s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-8dfbc837-4437-4210-b788-08a39a11cf4a req-ae577314-ea45-4339-a8e2-417bec94f556 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.488s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-8dfbc837-4437-4210-b788-08a39a11cf4a req-ae577314-ea45-4339-a8e2-417bec94f556 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae9c60b-8372-46a3-be3a-ca832bc33cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca', 'volume_size': 1, 'snapshot_id': 'c2991060-508f-4495-8784-fb974cddc542'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a19f48-5f0f-40e7-9cbd-a5ce2476d47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:46 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Volume volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca (b33d2abc-5e7b-4ef9-865a-fc58ae9109ca): created successfully Sep 23 00:29:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a19f48-5f0f-40e7-9cbd-a5ce2476d47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Flow 'volume_create_manager' (f65694b9-eb0d-4112-922b-417241ecc56e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-8dfbc837-4437-4210-b788-08a39a11cf4a req-ae577314-ea45-4339-a8e2-417bec94f556 tempest-TestInstancesWithCinderVolumes-1269575785 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-35523e3b-cc6d-4c14-b855-0267b8793d58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b620f268-7f7f-4242-b1a8-838fe2cce3a3', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:29:46 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-823a402d-1630-41a1-87d3-222013f59468 tempest-TestStampPattern-1454202446 None] Created volume successfully. Sep 23 00:29:46 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-8dfbc837-4437-4210-b788-08a39a11cf4a req-ae577314-ea45-4339-a8e2-417bec94f556 tempest-TestInstancesWithCinderVolumes-1269575785 None] attachment_update completed successfully. Sep 23 00:29:54 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-420842b0-66c4-44d8-8361-549f24df165f req-453d52eb-1140-4bae-86bc-794ddbb59804 tempest-TestInstancesWithCinderVolumes-1269575785 None] Terminate volume connection completed successfully. Sep 23 00:29:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-420842b0-66c4-44d8-8361-549f24df165f req-453d52eb-1140-4bae-86bc-794ddbb59804 tempest-TestInstancesWithCinderVolumes-1269575785 None] Deleting attachment 6cb842d6-535a-477f-ae72-03bfb4573f7a. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:29:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "cinder-aa954feb-1f28-486c-9c25-c345921ad673-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "cinder-aa954feb-1f28-486c-9c25-c345921ad673-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "cinder-quobyte-aa954feb-1f28-486c-9c25-c345921ad673" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "cinder-quobyte-aa954feb-1f28-486c-9c25-c345921ad673" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:54 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b87e8f9-595a-4522-bbb6-39adbe7d267d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-aa954feb-1f28-486c-9c25-c345921ad673 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:55 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-aa954feb-1f28-486c-9c25-c345921ad673 Sep 23 00:29:55 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:55 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-aa954feb-1f28-486c-9c25-c345921ad673" returned: 0 in 0.509s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-aa954feb-1f28-486c-9c25-c345921ad673 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:55 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-aa954feb-1f28-486c-9c25-c345921ad673 Sep 23 00:29:55 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:55 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-aa954feb-1f28-486c-9c25-c345921ad673" returned: 0 in 0.348s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "cinder-quobyte-aa954feb-1f28-486c-9c25-c345921ad673" released by "delete_volume" :: held 0.914s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:55 devstack cinder-volume[86481]: WARNING cinder.quota [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-928232517-1484455199 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-928232517-1484455199, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:29:55 devstack cinder-volume[86481]: WARNING cinder.quota [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-928232517-1484455199 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-928232517-1484455199, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:29:55 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Created reservations ['8a1447a5-fd53-4579-b287-af523a98d5fa', '67442642-7083-46d7-83d5-ab6174c0052d', 'f5972f58-d3cf-4ffd-9f81-ed0f78a3e8eb', 'b2061ee9-23aa-4cd3-b354-74575dd5cc14'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:29:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:56 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:56 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:29:56 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:56 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.361s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:56 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:56 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Deleted volume successfully. Sep 23 00:29:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9a5a5bfa-946d-425f-8efc-07e18dabd46c tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "cinder-aa954feb-1f28-486c-9c25-c345921ad673-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-2eee7a9c-e079-4cc6-a092-ea867b29f346 req-6e5cc3c8-06ff-4fd6-809a-a4afbd84d8c3 tempest-TestInstancesWithCinderVolumes-1269575785 None] Terminate volume connection completed successfully. Sep 23 00:29:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-2eee7a9c-e079-4cc6-a092-ea867b29f346 req-6e5cc3c8-06ff-4fd6-809a-a4afbd84d8c3 tempest-TestInstancesWithCinderVolumes-1269575785 None] Deleting attachment b620f268-7f7f-4242-b1a8-838fe2cce3a3. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:30:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "cinder-35523e3b-cc6d-4c14-b855-0267b8793d58-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "cinder-35523e3b-cc6d-4c14-b855-0267b8793d58-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "cinder-quobyte-35523e3b-cc6d-4c14-b855-0267b8793d58" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "cinder-quobyte-35523e3b-cc6d-4c14-b855-0267b8793d58" acquired by "delete_volume" :: waited 0.016s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:00 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8532b55e-0194-41d0-974b-96cf7c97e2b1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-35523e3b-cc6d-4c14-b855-0267b8793d58 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:00 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-35523e3b-cc6d-4c14-b855-0267b8793d58 Sep 23 00:30:00 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:00 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-35523e3b-cc6d-4c14-b855-0267b8793d58" returned: 0 in 0.543s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-35523e3b-cc6d-4c14-b855-0267b8793d58 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:00 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-35523e3b-cc6d-4c14-b855-0267b8793d58 Sep 23 00:30:00 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:01 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-35523e3b-cc6d-4c14-b855-0267b8793d58" returned: 0 in 0.303s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "cinder-quobyte-35523e3b-cc6d-4c14-b855-0267b8793d58" released by "delete_volume" :: held 0.917s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:01 devstack cinder-volume[86481]: WARNING cinder.quota [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1434670700-1977764197 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1434670700-1977764197, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:30:01 devstack cinder-volume[86481]: WARNING cinder.quota [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1434670700-1977764197 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1434670700-1977764197, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:30:01 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Created reservations ['4894028e-9652-4c0b-9571-31a2be5dca04', '2afd3f9b-962d-48bb-bb31-2819037b79a5', '0094287a-a2f1-4b4d-838b-b69393a0549b', '4774beff-9dad-4380-b827-d6a28c75415d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:01 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:30:01 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:01 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.310s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:01 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:01 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Deleted volume successfully. Sep 23 00:30:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2b790397-dda3-4086-8372-ab23d02f4e76 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "cinder-35523e3b-cc6d-4c14-b855-0267b8793d58-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-cc1e9f86-1b6a-474c-97a5-885fa72ef43c req-2d33aef6-6a35-491d-90f0-c6ff1947e8c6 tempest-TestInstancesWithCinderVolumes-1269575785 None] Terminate volume connection completed successfully. Sep 23 00:30:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-cc1e9f86-1b6a-474c-97a5-885fa72ef43c req-2d33aef6-6a35-491d-90f0-c6ff1947e8c6 tempest-TestInstancesWithCinderVolumes-1269575785 None] Deleting attachment 8cbc9a43-01b2-4411-a167-61b1dc757e74. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:30:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "cinder-cf6d34ff-a91d-4cf7-94a0-078b93257fb8-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "cinder-cf6d34ff-a91d-4cf7-94a0-078b93257fb8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "cinder-quobyte-cf6d34ff-a91d-4cf7-94a0-078b93257fb8" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "cinder-quobyte-cf6d34ff-a91d-4cf7-94a0-078b93257fb8" acquired by "delete_volume" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:07 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[19948510-5454-4781-bf6b-2e9bdb71a4f1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:07 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 Sep 23 00:30:07 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:08 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8" returned: 0 in 0.437s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:08 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8 Sep 23 00:30:08 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:08 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf6d34ff-a91d-4cf7-94a0-078b93257fb8" returned: 0 in 0.376s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "cinder-quobyte-cf6d34ff-a91d-4cf7-94a0-078b93257fb8" released by "delete_volume" :: held 0.863s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:08 devstack cinder-volume[86481]: WARNING cinder.quota [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-202992065-463140094 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-202992065-463140094, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:30:08 devstack cinder-volume[86481]: WARNING cinder.quota [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-202992065-463140094 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-202992065-463140094, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Created reservations ['9ebbde15-fc61-4316-b900-b88ab0cbe345', '93728629-6ad6-45d6-a03d-5f403481d707', '7c7ecffe-87f2-4047-b38e-b94a341bc20d', '6e8f8e93-0277-4157-bed5-7ce178254857'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:08 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:30:08 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:08 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.300s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:08 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Deleted volume successfully. Sep 23 00:30:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5f791d0a-2fa5-48b6-9fb9-44f9f3ed57a2 tempest-TestInstancesWithCinderVolumes-1269575785 None] Lock "cinder-cf6d34ff-a91d-4cf7-94a0-078b93257fb8-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-f15e3f2d-399d-4974-a695-9b728f5e15a7 req-e312e37c-2a75-4fcd-b748-0d7232c73fee tempest-TestStampPattern-1454202446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-f15e3f2d-399d-4974-a695-9b728f5e15a7 req-e312e37c-2a75-4fcd-b748-0d7232c73fee tempest-TestStampPattern-1454202446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [req-f15e3f2d-399d-4974-a695-9b728f5e15a7 req-e312e37c-2a75-4fcd-b748-0d7232c73fee tempest-TestStampPattern-1454202446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-f15e3f2d-399d-4974-a695-9b728f5e15a7 req-e312e37c-2a75-4fcd-b748-0d7232c73fee tempest-TestStampPattern-1454202446 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21', 'name': 'volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d525245-0221-43d1-9e82-4ce798e3e370', 'enforce_multipath': True} {{(pid=86481) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:30:15 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-f15e3f2d-399d-4974-a695-9b728f5e15a7 req-e312e37c-2a75-4fcd-b748-0d7232c73fee tempest-TestStampPattern-1454202446 None] attachment_update completed successfully. Sep 23 00:30:18 devstack cinder-volume[86481]: INFO cinder.volume.manager [req-841a69a2-9172-4218-8941-5abad616cdd3 req-9cf5cee8-53e4-4b11-9602-748223ca3468 tempest-TestStampPattern-1454202446 None] Terminate volume connection completed successfully. Sep 23 00:30:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [req-841a69a2-9172-4218-8941-5abad616cdd3 req-9cf5cee8-53e4-4b11-9602-748223ca3468 tempest-TestStampPattern-1454202446 None] Deleting attachment 7d525245-0221-43d1-9e82-4ce798e3e370. {{(pid=86481) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:30:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Acquiring lock "cinder-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Lock "cinder-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Acquiring lock "cinder-quobyte-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Lock "cinder-quobyte-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:23 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[54341c89-3821-4774-b3fe-cce4ed4e3e09]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:24 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca Sep 23 00:30:24 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:24 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" returned: 0 in 0.420s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:24 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca Sep 23 00:30:24 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Flow 'volume_create_manager' (725f33d5-e682-4f86-8baa-11125b4b4521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9b5f56-239c-4b8f-ad22-b777b656ad29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a9b5f56-239c-4b8f-ad22-b777b656ad29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1483956177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6455384c-f604-4900-873b-2e691408ca1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b748df9127ba479a86cf795564a5eacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:25Z,use_quota=True,user_id='714a48bf8a8f45d29dbb23d35567ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:24 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39a2d2b-4d4b-4dbe-84a3-55301388e905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39a2d2b-4d4b-4dbe-84a3-55301388e905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12dd696-4b85-4a33-8d2e-7dff5428f85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12dd696-4b85-4a33-8d2e-7dff5428f85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6455384c-f604-4900-873b-2e691408ca1f', 'volume_name': 'volume-6455384c-f604-4900-873b-2e691408ca1f', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05aa8999-121f-477e-bff9-aee810f9135c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05aa8999-121f-477e-bff9-aee810f9135c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a81dee-57c2-411c-b4aa-b1d4bf606f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume 6455384c-f604-4900-873b-2e691408ca1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6455384c-f604-4900-873b-2e691408ca1f', 'volume_size': 1} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1483956177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6455384c-f604-4900-873b-2e691408ca1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b748df9127ba479a86cf795564a5eacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:25Z,use_quota=True,user_id='714a48bf8a8f45d29dbb23d35567ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Creating volume 6455384c-f604-4900-873b-2e691408ca1f {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:24 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6455384c-f604-4900-873b-2e691408ca1f 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" returned: 0 in 0.368s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:24 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6455384c-f604-4900-873b-2e691408ca1f 1073741824 Sep 23 00:30:24 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Lock "cinder-quobyte-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca" released by "delete_volume" :: held 0.852s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Created reservations ['2747bf10-166c-4d10-a69b-a85ca1e9a97b', '5cd36f4b-f5b0-4bee-95d0-53a0eab29750', 'e9bb2c22-241b-4be0-9930-d32a19752518', 'e74968bb-5054-4cb9-8d7c-fba63a65f22b'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:24 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:30:24 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:25 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.321s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:25 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Deleted volume successfully. Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fb55f2c8-47a2-48ed-b948-24b1dae5bc4e tempest-TestStampPattern-1454202446 None] Lock "cinder-b33d2abc-5e7b-4ef9-865a-fc58ae9109ca-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:25 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6455384c-f604-4900-873b-2e691408ca1f 1073741824" returned: 0 in 0.570s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6455384c-f604-4900-873b-2e691408ca1f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:25 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6455384c-f604-4900-873b-2e691408ca1f Sep 23 00:30:25 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Acquiring lock "cinder-c2991060-508f-4495-8784-fb974cddc542-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Lock "cinder-c2991060-508f-4495-8784-fb974cddc542-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Acquiring lock "cinder-quobyte-0e484561-a8fd-4d85-805e-13cd35d9f1f3" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Lock "cinder-quobyte-0e484561-a8fd-4d85-805e-13cd35d9f1f3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Acquiring lock "cinder-quobyte-c2991060-508f-4495-8784-fb974cddc542" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Lock "cinder-quobyte-c2991060-508f-4495-8784-fb974cddc542" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Deleting offline snapshot c2991060-508f-4495-8784-fb974cddc542 of volume 0e484561-a8fd-4d85-805e-13cd35d9f1f3 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] snapshot_file for this snap is: volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acd4b4a-1706-4c1c-b1a4-361ce54d9019]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:25 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 Sep 23 00:30:25 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:25 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6455384c-f604-4900-873b-2e691408ca1f" returned: 0 in 0.281s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a81dee-57c2-411c-b4aa-b1d4bf606f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6455384c-f604-4900-873b-2e691408ca1f', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68efb14-8908-452e-a633-6094fea9207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:25 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume volume-6455384c-f604-4900-873b-2e691408ca1f (6455384c-f604-4900-873b-2e691408ca1f): created successfully Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68efb14-8908-452e-a633-6094fea9207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Flow 'volume_create_manager' (725f33d5-e682-4f86-8baa-11125b4b4521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:25 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-32fb4ebf-8a11-4856-a909-05e934cd38e1 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Created volume successfully. Sep 23 00:30:25 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542" returned: 0 in 0.427s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e176205-6ba6-44a7-9068-09f1b877ffe3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:26 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 Sep 23 00:30:26 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:26 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3" returned: 0 in 0.575s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:26 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 Sep 23 00:30:26 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:26 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542" returned: 0 in 0.410s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:26 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542 Sep 23 00:30:26 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:27 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3.c2991060-508f-4495-8784-fb974cddc542" returned: 0 in 0.382s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Flow 'volume_create_manager' (e7076a99-91b2-48d7-9602-690ce26304ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ce13ff-119f-4e7a-9710-e2ec7490a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Lock "cinder-quobyte-c2991060-508f-4495-8784-fb974cddc542" released by "_delete_snapshot" :: held 2.007s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Lock "cinder-quobyte-0e484561-a8fd-4d85-805e-13cd35d9f1f3" released by "delete_snapshot" :: held 2.041s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ce13ff-119f-4e7a-9710-e2ec7490a086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1218448915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e23d9a9-b3f6-49de-8e6e-26882ccef2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b748df9127ba479a86cf795564a5eacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:27Z,use_quota=True,user_id='714a48bf8a8f45d29dbb23d35567ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa79123-fe71-49ab-93a3-3f333d988c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa79123-fe71-49ab-93a3-3f333d988c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c736b51-475c-4459-a7b0-b599437fe4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c736b51-475c-4459-a7b0-b599437fe4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e23d9a9-b3f6-49de-8e6e-26882ccef2ad', 'volume_name': 'volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883cf75c-553e-485e-8b3d-4afaf0fb9f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883cf75c-553e-485e-8b3d-4afaf0fb9f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67284afd-c924-4812-98e4-a4e4f42da99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:27 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume 6e23d9a9-b3f6-49de-8e6e-26882ccef2ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad', 'volume_size': 1} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1218448915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e23d9a9-b3f6-49de-8e6e-26882ccef2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b748df9127ba479a86cf795564a5eacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:27Z,use_quota=True,user_id='714a48bf8a8f45d29dbb23d35567ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Creating volume 6e23d9a9-b3f6-49de-8e6e-26882ccef2ad {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:27 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:27 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad 1073741824 Sep 23 00:30:27 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Created reservations ['a0dae50e-8294-4d9e-ac2e-a063601700a0', '4dedcb6b-d2d8-4bfe-8ca4-c2a0da297963', '51b7a1f4-3d0f-4d1e-b05b-627012e0b793', '76a3ad2e-17f4-44cf-924a-6e324892dedc'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:27 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Delete snapshot completed successfully. Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dcc0a921-fc88-489f-b3e4-e2d5f6f7ec60 tempest-TestStampPattern-1454202446 None] Lock "cinder-c2991060-508f-4495-8784-fb974cddc542-delete_snapshot" released by "delete_snapshot" :: held 2.389s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Flow 'volume_create_manager' (bc17490e-108f-4eb5-9911-94a058f79e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aacabb7-cac1-4238-b3d9-406c208acc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aacabb7-cac1-4238-b3d9-406c208acc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1925057412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d937c962-e689-440c-9ae2-6a2be11fe6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b748df9127ba479a86cf795564a5eacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:28Z,use_quota=True,user_id='714a48bf8a8f45d29dbb23d35567ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be31b91f-812f-4b27-a814-e4fb5f39485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be31b91f-812f-4b27-a814-e4fb5f39485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c08f255-7e8e-43be-839c-126802685e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c08f255-7e8e-43be-839c-126802685e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd937c962-e689-440c-9ae2-6a2be11fe6f7', 'volume_name': 'volume-d937c962-e689-440c-9ae2-6a2be11fe6f7', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ded68cb-649b-4c43-aacc-ea65871aa59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ded68cb-649b-4c43-aacc-ea65871aa59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d658cb84-9345-4c21-865f-4b222708690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume d937c962-e689-440c-9ae2-6a2be11fe6f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d937c962-e689-440c-9ae2-6a2be11fe6f7', 'volume_size': 1} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:28 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad 1073741824" returned: 0 in 0.738s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:28 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad Sep 23 00:30:28 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Flow 'volume_create_manager' (d2a0a4b5-7fe2-46f0-a59b-27604327f671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eee5ea4-fab4-4fc7-bfb1-873be56235cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eee5ea4-fab4-4fc7-bfb1-873be56235cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-368071018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505c6855-f53c-4457-a3bc-8db260012c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b748df9127ba479a86cf795564a5eacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:28Z,use_quota=True,user_id='714a48bf8a8f45d29dbb23d35567ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19555ee8-2f69-4df5-aad5-a7115b2a383c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19555ee8-2f69-4df5-aad5-a7115b2a383c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2479469-e1d6-4c5a-93c9-17af86b08341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2479469-e1d6-4c5a-93c9-17af86b08341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '505c6855-f53c-4457-a3bc-8db260012c02', 'volume_name': 'volume-505c6855-f53c-4457-a3bc-8db260012c02', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0105133c-6655-42d6-bc72-3ddb1858c1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0105133c-6655-42d6-bc72-3ddb1858c1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1879d3-5597-4750-a065-efff2f7fcf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume 505c6855-f53c-4457-a3bc-8db260012c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-505c6855-f53c-4457-a3bc-8db260012c02', 'volume_size': 1} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:28 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad" returned: 0 in 0.454s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.703s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1925057412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d937c962-e689-440c-9ae2-6a2be11fe6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b748df9127ba479a86cf795564a5eacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:28Z,use_quota=True,user_id='714a48bf8a8f45d29dbb23d35567ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Creating volume d937c962-e689-440c-9ae2-6a2be11fe6f7 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:28 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d937c962-e689-440c-9ae2-6a2be11fe6f7 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:28 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d937c962-e689-440c-9ae2-6a2be11fe6f7 1073741824 Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67284afd-c924-4812-98e4-a4e4f42da99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18f1dfd-f50b-45f5-b228-5af24ac76391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad (6e23d9a9-b3f6-49de-8e6e-26882ccef2ad): created successfully Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18f1dfd-f50b-45f5-b228-5af24ac76391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Flow 'volume_create_manager' (e7076a99-91b2-48d7-9602-690ce26304ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:28 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e5be952d-1832-4922-9346-525f7b41136f tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Created volume successfully. Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Flow 'volume_create_manager' (9bebf953-b381-4170-a02d-bd341b17400f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466b7b0f-4d02-40d7-b570-65067d4d1b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466b7b0f-4d02-40d7-b570-65067d4d1b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-862431395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea83d9f9-87b9-4a4e-95c3-63c4235a0989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b748df9127ba479a86cf795564a5eacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:29Z,use_quota=True,user_id='714a48bf8a8f45d29dbb23d35567ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0455057-e28d-4d42-b2a6-baa8e12edf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0455057-e28d-4d42-b2a6-baa8e12edf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11519b07-723c-476c-8f70-f821582e4ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11519b07-723c-476c-8f70-f821582e4ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea83d9f9-87b9-4a4e-95c3-63c4235a0989', 'volume_name': 'volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc834f64-0ec6-49f6-ad38-2699cc056068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc834f64-0ec6-49f6-ad38-2699cc056068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb61f37d-aff3-4c21-95d9-17ecf4a8188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume ea83d9f9-87b9-4a4e-95c3-63c4235a0989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989', 'volume_size': 1} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:29 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d937c962-e689-440c-9ae2-6a2be11fe6f7 1073741824" returned: 0 in 0.772s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d937c962-e689-440c-9ae2-6a2be11fe6f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:29 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d937c962-e689-440c-9ae2-6a2be11fe6f7 Sep 23 00:30:29 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Flow 'volume_create_manager' (f9b0de4f-f801-4b69-a625-ae648c51ccba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1eb0c9-23ba-4d68-9f45-b15b3558bf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1eb0c9-23ba-4d68-9f45-b15b3558bf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1340485830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f059b1f-6afb-4349-83c6-291d640363f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b748df9127ba479a86cf795564a5eacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:30Z,use_quota=True,user_id='714a48bf8a8f45d29dbb23d35567ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3b5684-7350-48ae-b044-d9a93b7926d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3b5684-7350-48ae-b044-d9a93b7926d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fd7ed0-8803-4577-bb92-0e771bf5e6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fd7ed0-8803-4577-bb92-0e771bf5e6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f059b1f-6afb-4349-83c6-291d640363f8', 'volume_name': 'volume-7f059b1f-6afb-4349-83c6-291d640363f8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4990f12a-257f-4f4b-8cf0-11986ec8430f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4990f12a-257f-4f4b-8cf0-11986ec8430f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8bacb6-f1dc-432f-aa37-f06e58361ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume 7f059b1f-6afb-4349-83c6-291d640363f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f059b1f-6afb-4349-83c6-291d640363f8', 'volume_size': 1} Sep 23 00:30:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:30 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d937c962-e689-440c-9ae2-6a2be11fe6f7" returned: 0 in 0.434s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.480s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-368071018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505c6855-f53c-4457-a3bc-8db260012c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b748df9127ba479a86cf795564a5eacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:28Z,use_quota=True,user_id='714a48bf8a8f45d29dbb23d35567ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Creating volume 505c6855-f53c-4457-a3bc-8db260012c02 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:30 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-505c6855-f53c-4457-a3bc-8db260012c02 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:30 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-505c6855-f53c-4457-a3bc-8db260012c02 1073741824 Sep 23 00:30:30 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d658cb84-9345-4c21-865f-4b222708690d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d937c962-e689-440c-9ae2-6a2be11fe6f7', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bba4922-c74c-4c15-855d-345a6a803b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:30 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume volume-d937c962-e689-440c-9ae2-6a2be11fe6f7 (d937c962-e689-440c-9ae2-6a2be11fe6f7): created successfully Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bba4922-c74c-4c15-855d-345a6a803b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Flow 'volume_create_manager' (bc17490e-108f-4eb5-9911-94a058f79e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:30 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-db772db8-f30f-4bc8-b528-abf8e08ea0b9 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Created volume successfully. Sep 23 00:30:31 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-505c6855-f53c-4457-a3bc-8db260012c02 1073741824" returned: 0 in 0.927s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-505c6855-f53c-4457-a3bc-8db260012c02 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:31 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-505c6855-f53c-4457-a3bc-8db260012c02 Sep 23 00:30:31 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:31 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-505c6855-f53c-4457-a3bc-8db260012c02" returned: 0 in 0.341s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.137s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-862431395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea83d9f9-87b9-4a4e-95c3-63c4235a0989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b748df9127ba479a86cf795564a5eacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:29Z,use_quota=True,user_id='714a48bf8a8f45d29dbb23d35567ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Creating volume ea83d9f9-87b9-4a4e-95c3-63c4235a0989 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:31 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1879d3-5597-4750-a065-efff2f7fcf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505c6855-f53c-4457-a3bc-8db260012c02', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:31 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989 1073741824 Sep 23 00:30:31 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e12ec24-a543-4b2c-98aa-6384c359b4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:31 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume volume-505c6855-f53c-4457-a3bc-8db260012c02 (505c6855-f53c-4457-a3bc-8db260012c02): created successfully Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e12ec24-a543-4b2c-98aa-6384c359b4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Flow 'volume_create_manager' (d2a0a4b5-7fe2-46f0-a59b-27604327f671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:31 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-211f0c9e-f133-4e9c-bbad-b7828a4a1bab tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Created volume successfully. Sep 23 00:30:32 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989 1073741824" returned: 0 in 0.723s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:32 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989 Sep 23 00:30:32 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:32 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989" returned: 0 in 0.399s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.825s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1340485830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f059b1f-6afb-4349-83c6-291d640363f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b748df9127ba479a86cf795564a5eacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:30Z,use_quota=True,user_id='714a48bf8a8f45d29dbb23d35567ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Creating volume 7f059b1f-6afb-4349-83c6-291d640363f8 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:32 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f059b1f-6afb-4349-83c6-291d640363f8 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:32 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f059b1f-6afb-4349-83c6-291d640363f8 1073741824 Sep 23 00:30:32 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb61f37d-aff3-4c21-95d9-17ecf4a8188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ae7958-9c63-4864-b789-a21a7f021bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:32 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989 (ea83d9f9-87b9-4a4e-95c3-63c4235a0989): created successfully Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ae7958-9c63-4864-b789-a21a7f021bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Flow 'volume_create_manager' (9bebf953-b381-4170-a02d-bd341b17400f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:32 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-09064bc2-d839-4247-912a-57a203449e93 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Created volume successfully. Sep 23 00:30:33 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f059b1f-6afb-4349-83c6-291d640363f8 1073741824" returned: 0 in 0.706s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f059b1f-6afb-4349-83c6-291d640363f8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:33 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f059b1f-6afb-4349-83c6-291d640363f8 Sep 23 00:30:33 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:33 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f059b1f-6afb-4349-83c6-291d640363f8" returned: 0 in 0.297s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8bacb6-f1dc-432f-aa37-f06e58361ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f059b1f-6afb-4349-83c6-291d640363f8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea5f4b4-a5b7-4150-b28e-528e316a6ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:34 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Volume volume-7f059b1f-6afb-4349-83c6-291d640363f8 (7f059b1f-6afb-4349-83c6-291d640363f8): created successfully Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea5f4b4-a5b7-4150-b28e-528e316a6ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Flow 'volume_create_manager' (f9b0de4f-f801-4b69-a625-ae648c51ccba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:34 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2280b367-32a9-4572-bbd7-aa931a70baaf tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Created volume successfully. Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "cinder-7f059b1f-6afb-4349-83c6-291d640363f8-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-7f059b1f-6afb-4349-83c6-291d640363f8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "cinder-quobyte-7f059b1f-6afb-4349-83c6-291d640363f8" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-quobyte-7f059b1f-6afb-4349-83c6-291d640363f8" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff885a7-ddad-4dbe-bcf5-7e8be6cf3155]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f059b1f-6afb-4349-83c6-291d640363f8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Acquiring lock "cinder-0e484561-a8fd-4d85-805e-13cd35d9f1f3-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Lock "cinder-0e484561-a8fd-4d85-805e-13cd35d9f1f3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:34 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f059b1f-6afb-4349-83c6-291d640363f8 Sep 23 00:30:34 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Acquiring lock "cinder-quobyte-0e484561-a8fd-4d85-805e-13cd35d9f1f3" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Lock "cinder-quobyte-0e484561-a8fd-4d85-805e-13cd35d9f1f3" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdfc61c-5211-4a4c-800a-99b0d0a0b679]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:35 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 Sep 23 00:30:35 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:35 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f059b1f-6afb-4349-83c6-291d640363f8" returned: 0 in 0.447s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f059b1f-6afb-4349-83c6-291d640363f8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:35 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f059b1f-6afb-4349-83c6-291d640363f8 Sep 23 00:30:35 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:35 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3" returned: 0 in 0.451s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:35 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7f059b1f-6afb-4349-83c6-291d640363f8" returned: 0 in 0.285s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:35 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3 Sep 23 00:30:35 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-quobyte-7f059b1f-6afb-4349-83c6-291d640363f8" released by "delete_volume" :: held 0.795s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Created reservations ['d9ec045e-289b-4e49-9c34-c4ab578e26f5', '8c4cc754-2272-4362-8e00-79e10552d771', '56c3d93b-7ac5-4d36-a7e4-92ca5cb73632', 'fb59e882-0e58-4cb3-a216-a76d8cd6caef'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:35 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:30:35 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:35 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0e484561-a8fd-4d85-805e-13cd35d9f1f3" returned: 0 in 0.304s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Lock "cinder-quobyte-0e484561-a8fd-4d85-805e-13cd35d9f1f3" released by "delete_volume" :: held 0.847s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "cinder-ea83d9f9-87b9-4a4e-95c3-63c4235a0989-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-ea83d9f9-87b9-4a4e-95c3-63c4235a0989-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "cinder-quobyte-ea83d9f9-87b9-4a4e-95c3-63c4235a0989" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Created reservations ['b6312c6c-2ff1-4edd-8b66-ea99399fc0d4', 'dd276f51-15b5-4b74-ac4d-8f9fd4075417', 'd966d287-d289-43f4-8020-2822d2617f28', '9aef5f35-3a4b-4acf-adc0-1b579f9afbfb'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-quobyte-ea83d9f9-87b9-4a4e-95c3-63c4235a0989" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6501a144-f5c0-4be4-a95b-08430d750dac]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:35 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.352s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:35 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Deleted volume successfully. Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6781a52b-278b-48d4-b4ab-dbea97cedffe tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-7f059b1f-6afb-4349-83c6-291d640363f8-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:36 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:30:36 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:36 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989 Sep 23 00:30:36 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:36 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989" returned: 0 in 0.464s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:36 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.388s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:36 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989 Sep 23 00:30:36 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:36 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Deleted volume successfully. Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6c3c3b76-1062-4fd5-b642-0cecaecc192f tempest-TestStampPattern-1454202446 None] Lock "cinder-0e484561-a8fd-4d85-805e-13cd35d9f1f3-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:36 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ea83d9f9-87b9-4a4e-95c3-63c4235a0989" returned: 0 in 0.316s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-quobyte-ea83d9f9-87b9-4a4e-95c3-63c4235a0989" released by "delete_volume" :: held 0.842s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Created reservations ['c51cee61-c9d5-435f-b835-dca04c7f1432', '8564f48f-f9b3-465d-a26a-e05dc4c36f4e', '79fe3bc2-6a97-428b-b49f-6d0ea22c236d', '7bd7a473-627c-45ce-8740-5b59df9f759b'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:36 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:30:36 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "cinder-505c6855-f53c-4457-a3bc-8db260012c02-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-505c6855-f53c-4457-a3bc-8db260012c02-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "cinder-quobyte-505c6855-f53c-4457-a3bc-8db260012c02" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-quobyte-505c6855-f53c-4457-a3bc-8db260012c02" acquired by "delete_volume" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d1ddae-06bd-4eba-942d-5c0d8be89b96]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-505c6855-f53c-4457-a3bc-8db260012c02 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:37 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.333s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:37 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Deleted volume successfully. Sep 23 00:30:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a6fa91b9-53d6-40cf-b572-99390520a973 tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-ea83d9f9-87b9-4a4e-95c3-63c4235a0989-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:37 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-505c6855-f53c-4457-a3bc-8db260012c02 Sep 23 00:30:37 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:37 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-505c6855-f53c-4457-a3bc-8db260012c02" returned: 0 in 0.485s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-505c6855-f53c-4457-a3bc-8db260012c02 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:37 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-505c6855-f53c-4457-a3bc-8db260012c02 Sep 23 00:30:37 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:37 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-505c6855-f53c-4457-a3bc-8db260012c02" returned: 0 in 0.360s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-quobyte-505c6855-f53c-4457-a3bc-8db260012c02" released by "delete_volume" :: held 0.906s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Created reservations ['cf5d0199-7e62-48b9-84fa-cfaa55f9483d', 'd9040349-256f-4745-9196-2b375ee6fcf2', 'ede6d09d-4810-4736-90bb-dbb3f3211e7d', 'c20a9c22-9a20-4714-bbcc-a6a6d275e31d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:38 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:30:38 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "cinder-d937c962-e689-440c-9ae2-6a2be11fe6f7-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-d937c962-e689-440c-9ae2-6a2be11fe6f7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "cinder-quobyte-d937c962-e689-440c-9ae2-6a2be11fe6f7" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-quobyte-d937c962-e689-440c-9ae2-6a2be11fe6f7" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2033532-1001-4466-a2df-57775ed6130e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d937c962-e689-440c-9ae2-6a2be11fe6f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:38 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d937c962-e689-440c-9ae2-6a2be11fe6f7 Sep 23 00:30:38 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:38 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.372s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:38 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Deleted volume successfully. Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-236d6e68-3988-43aa-aee3-0292a95a2afb tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-505c6855-f53c-4457-a3bc-8db260012c02-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:38 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d937c962-e689-440c-9ae2-6a2be11fe6f7" returned: 0 in 0.478s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d937c962-e689-440c-9ae2-6a2be11fe6f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:38 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d937c962-e689-440c-9ae2-6a2be11fe6f7 Sep 23 00:30:38 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:39 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d937c962-e689-440c-9ae2-6a2be11fe6f7" returned: 0 in 0.335s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-quobyte-d937c962-e689-440c-9ae2-6a2be11fe6f7" released by "delete_volume" :: held 0.888s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Created reservations ['ea07f690-ef9a-42e4-ab15-c5ece1f5f859', '0b1153ff-d284-465b-a713-8b6c1dfe57d0', '591663e8-1ab9-4928-b35d-58d22249edb1', '9d34bdc9-2958-4954-8fce-55c1edd1474c'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "cinder-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:39 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:39 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "cinder-quobyte-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-quobyte-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[819cfadb-eb71-4334-93ba-50cad05bb5be]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:39 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad Sep 23 00:30:39 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:39 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.442s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:39 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Deleted volume successfully. Sep 23 00:30:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-952b0a2a-6fd1-4f9b-927d-9fab52934cba tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-d937c962-e689-440c-9ae2-6a2be11fe6f7-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:40 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad" returned: 0 in 0.525s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:40 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad Sep 23 00:30:40 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:40 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad" returned: 0 in 0.353s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-quobyte-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad" released by "delete_volume" :: held 0.956s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:40 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Created reservations ['3326ff4a-68ba-4375-9f5a-971579e1ade0', '789d1138-ecd2-4958-b68b-8c2c87951174', 'f046c7f6-819d-4208-a171-c2542eba5b1b', 'bb1ea3d9-30d3-46ed-8509-cc1647a4aff6'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:40 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:30:40 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:41 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.309s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:41 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:41 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Deleted volume successfully. Sep 23 00:30:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-a22ff006-5e0a-4f62-a5e6-f31d9c75de8a tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-6e23d9a9-b3f6-49de-8e6e-26882ccef2ad-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "cinder-6455384c-f604-4900-873b-2e691408ca1f-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-6455384c-f604-4900-873b-2e691408ca1f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "cinder-quobyte-6455384c-f604-4900-873b-2e691408ca1f" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-quobyte-6455384c-f604-4900-873b-2e691408ca1f" acquired by "delete_volume" :: waited 0.016s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:41 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18a21ad-acc3-4bf7-9837-f7a9bf993192]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6455384c-f604-4900-873b-2e691408ca1f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:42 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6455384c-f604-4900-873b-2e691408ca1f Sep 23 00:30:42 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:42 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6455384c-f604-4900-873b-2e691408ca1f" returned: 0 in 0.491s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6455384c-f604-4900-873b-2e691408ca1f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:42 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6455384c-f604-4900-873b-2e691408ca1f Sep 23 00:30:42 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:42 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6455384c-f604-4900-873b-2e691408ca1f" returned: 0 in 0.318s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:42 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-quobyte-6455384c-f604-4900-873b-2e691408ca1f" released by "delete_volume" :: held 0.858s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:42 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Created reservations ['b2e11128-c2ff-4da3-950e-a8584feddd21', 'af7ad1b4-ba41-4141-876b-7e172d37021c', '9d20cca8-9639-499e-aa59-eb53addf04f3', '77686a1a-1a0b-4f2d-8fbb-48a8dfa8eb6b'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:30:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:42 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:30:42 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:43 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.286s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:43 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:43 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Deleted volume successfully. Sep 23 00:30:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-82d02458-4d2a-44a2-aad8-f0650c28ce8d tempest-CreateVolumesFromSourceVolumeTest-2093301755 None] Lock "cinder-6455384c-f604-4900-873b-2e691408ca1f-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:30:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:45 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:30:45 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:45 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.288s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:30:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:30:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:30:52 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=119,cinder:SELECT=87,cinder:INSERT=25,cinder:DELETE=6 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:53 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=93,cinder:INSERT=30,cinder:UPDATE=115,cinder:DELETE=12 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Flow 'volume_create_manager' (f46c9ffb-b05c-470e-8489-0657fbf08d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4b2a2b-522d-426a-8d92-9c82d9463997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4b2a2b-522d-426a-8d92-9c82d9463997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65934752-ce1d-4686-a6bd-31a915b9e435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81889fb0df8a475c96cb916aa6f52f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:57Z,use_quota=True,user_id='f0ad129054f74018a121dce2f8ce3e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca08e743-639e-4ac7-8ae8-b39039b0005a),volume_type_id=ca08e743-639e-4ac7-8ae8-b39039b0005a)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82caf040-6dcd-4e81-8878-914a416dbea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82caf040-6dcd-4e81-8878-914a416dbea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1aa8b89-732e-44e3-93cd-029f684f5f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.image.glance [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Creating Keystone auth plugin from conf {{(pid=86481) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1aa8b89-732e-44e3-93cd-029f684f5f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65934752-ce1d-4686-a6bd-31a915b9e435', 'volume_name': 'volume-65934752-ce1d-4686-a6bd-31a915b9e435', 'volume_size': 1, 'image_id': 'e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b1c0438ec48a2a80840b9a60a146807', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '81889fb0df8a475c96cb916aa6f52f65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '176681b4abefbd0a1d9aaa290b85d24776dd4757ee6f682b843228f739efa5dd8c938f331b15601625e1ae01dfd2786836e7981d8a2c4bae81ef7d7c7a769110', 'id': 'e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'created_at': datetime.datetime(2026, 9, 22, 22, 30, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 30, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e77ed1fd-bab4-4fc0-a282-79cc1c01e58f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191ba593-3ad1-4043-9925-401bf2178fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191ba593-3ad1-4043-9925-401bf2178fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1cffe9-2242-4ac1-9f2a-f8f452f8ec1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:57 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Volume 65934752-ce1d-4686-a6bd-31a915b9e435: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65934752-ce1d-4686-a6bd-31a915b9e435', 'volume_size': 1, 'image_id': 'e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b1c0438ec48a2a80840b9a60a146807', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '81889fb0df8a475c96cb916aa6f52f65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '176681b4abefbd0a1d9aaa290b85d24776dd4757ee6f682b843228f739efa5dd8c938f331b15601625e1ae01dfd2786836e7981d8a2c4bae81ef7d7c7a769110', 'id': 'e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'created_at': datetime.datetime(2026, 9, 22, 22, 30, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 30, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e77ed1fd-bab4-4fc0-a282-79cc1c01e58f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Trying to clone 65934752-ce1d-4686-a6bd-31a915b9e435 from image e77ed1fd-bab4-4fc0-a282-79cc1c01e58f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'metadata': {}}]). {{(pid=86481) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:30:57 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[2188005c-8952-4909-971f-5b6171d4f376]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:57 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD Sep 23 00:30:57 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:58 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:58 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD Sep 23 00:30:58 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:58 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:30:58 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Temporary image e77ed1fd-bab4-4fc0-a282-79cc1c01e58f is fetched for user f0ad129054f74018a121dce2f8ce3e2a. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:30:58 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6760dc04-a142-4c48-b7ec-69c72218d2ff]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:58 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD Sep 23 00:30:58 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:58 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:59 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD Sep 23 00:30:59 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:59 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65934752-ce1d-4686-a6bd-31a915b9e435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81889fb0df8a475c96cb916aa6f52f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:57Z,use_quota=True,user_id='f0ad129054f74018a121dce2f8ce3e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca08e743-639e-4ac7-8ae8-b39039b0005a),volume_type_id=ca08e743-639e-4ac7-8ae8-b39039b0005a)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Creating volume 65934752-ce1d-4686-a6bd-31a915b9e435 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:59 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:59 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 1073741824 Sep 23 00:30:59 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:59 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 1073741824" returned: 0 in 0.468s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:59 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 Sep 23 00:30:59 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:00 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435" returned: 0 in 0.285s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:00 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Attempting download of e77ed1fd-bab4-4fc0-a282-79cc1c01e58f ((None, [{'url': 'file:///opt/stack/data/glance/images/e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'metadata': {}}])) to volume 65934752-ce1d-4686-a6bd-31a915b9e435. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:31:00 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f6aeba-8f61-411a-8431-0ac2671c55d5]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_pqc1_knl {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:00 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_pqc1_knl Sep 23 00:31:00 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:00 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_pqc1_knl" returned: 0 in 0.370s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_pqc1_knl {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:00 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_pqc1_knl Sep 23 00:31:00 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:00 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_pqc1_knl" returned: 1 in 0.383s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_pqc1_knl' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:00 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f590a1ed-08cc-4658-872a-99c5900ba35e]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD Sep 23 00:31:01 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD Sep 23 00:31:01 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD" returned: 1 in 0.382s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:31:01 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] e77ed1fd-bab4-4fc0-a282-79cc1c01e58f was raw, converting to qcow2 {{(pid=86481) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:31:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 Sep 23 00:31:01 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435" returned: 0 in 0.575s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e77ed1fd-bab4-4fc0-a282-79cc1c01e58f_rlg8cp0gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:31:02 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:02 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 1G Sep 23 00:31:02 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 1G" returned: 0 in 0.337s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Downloaded image e77ed1fd-bab4-4fc0-a282-79cc1c01e58f ((None, [{'url': 'file:///opt/stack/data/glance/images/e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'metadata': {}}])) to volume 65934752-ce1d-4686-a6bd-31a915b9e435 successfully. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Temporary image e77ed1fd-bab4-4fc0-a282-79cc1c01e58f for user f0ad129054f74018a121dce2f8ce3e2a is deleted. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Marking volume 65934752-ce1d-4686-a6bd-31a915b9e435 as bootable. {{(pid=86481) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Copying metadata from image e77ed1fd-bab4-4fc0-a282-79cc1c01e58f to 65934752-ce1d-4686-a6bd-31a915b9e435. {{(pid=86481) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Creating volume glance metadata for volume 65934752-ce1d-4686-a6bd-31a915b9e435 backed by image e77ed1fd-bab4-4fc0-a282-79cc1c01e58f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0b1c0438ec48a2a80840b9a60a146807', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86481) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1cffe9-2242-4ac1-9f2a-f8f452f8ec1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65934752-ce1d-4686-a6bd-31a915b9e435', 'volume_size': 1, 'image_id': 'e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b1c0438ec48a2a80840b9a60a146807', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '81889fb0df8a475c96cb916aa6f52f65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '176681b4abefbd0a1d9aaa290b85d24776dd4757ee6f682b843228f739efa5dd8c938f331b15601625e1ae01dfd2786836e7981d8a2c4bae81ef7d7c7a769110', 'id': 'e77ed1fd-bab4-4fc0-a282-79cc1c01e58f', 'created_at': datetime.datetime(2026, 9, 22, 22, 30, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 30, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e77ed1fd-bab4-4fc0-a282-79cc1c01e58f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198e7f1b-9732-456c-b766-0c4c4157d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:02 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Volume volume-65934752-ce1d-4686-a6bd-31a915b9e435 (65934752-ce1d-4686-a6bd-31a915b9e435): created successfully Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198e7f1b-9732-456c-b766-0c4c4157d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Flow 'volume_create_manager' (f46c9ffb-b05c-470e-8489-0657fbf08d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:02 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3e31bdd4-b46e-4bec-ad09-e5eb9b1867c3 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Created volume successfully. Sep 23 00:31:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Acquiring lock "cinder-65934752-ce1d-4686-a6bd-31a915b9e435-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Lock "cinder-65934752-ce1d-4686-a6bd-31a915b9e435-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Acquiring lock "cinder-quobyte-65934752-ce1d-4686-a6bd-31a915b9e435" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Lock "cinder-quobyte-65934752-ce1d-4686-a6bd-31a915b9e435" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:03 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6032b340-578a-475f-b31d-5d846c30858a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:03 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 Sep 23 00:31:03 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:04 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435" returned: 0 in 0.452s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:04 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435 Sep 23 00:31:04 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:04 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-65934752-ce1d-4686-a6bd-31a915b9e435" returned: 0 in 0.335s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Lock "cinder-quobyte-65934752-ce1d-4686-a6bd-31a915b9e435" released by "delete_volume" :: held 0.840s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:04 devstack cinder-volume[86481]: WARNING cinder.quota [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:31:04 devstack cinder-volume[86481]: WARNING cinder.quota [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:31:04 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Created reservations ['b5be0f01-ad88-4169-874f-1166b2aa45be', '202a768e-f960-4289-8dfd-8a42452b63b0', '0618e605-7aee-4bbf-8d87-f24d212fa34d', 'f5808bfa-75cc-46cf-ad5f-3fa76f7b6dc0'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:04 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:31:04 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:05 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.356s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:05 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Deleted volume successfully. Sep 23 00:31:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3c7c7861-c254-4ba7-8d1a-65366459df34 tempest-VolumeAndVolumeTypeFromImageTest-1245625955 None] Lock "cinder-65934752-ce1d-4686-a6bd-31a915b9e435-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Flow 'volume_create_manager' (734c0804-dc34-440d-a057-b260737d7771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613a4241-0a4b-4e97-a8bc-d5d4fbc952d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (613a4241-0a4b-4e97-a8bc-d5d4fbc952d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a91e73-4977-4a22-8976-a9ece937dfe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ca434d4d814e26832ec3623a805553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:11Z,use_quota=True,user_id='872e56845ee748ef83dc0301a43816c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33bba26e-eadd-4e1a-a296-4856049a9de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33bba26e-eadd-4e1a-a296-4856049a9de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f93ac5-e8b6-4b20-97f5-a526cc1ec6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f93ac5-e8b6-4b20-97f5-a526cc1ec6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a91e73-4977-4a22-8976-a9ece937dfe4', 'volume_name': 'volume-51a91e73-4977-4a22-8976-a9ece937dfe4', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae222565-3ac4-46d1-ac57-d5636879a440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae222565-3ac4-46d1-ac57-d5636879a440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d540a8-b970-49ad-a137-14cdf79824fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:10 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Volume 51a91e73-4977-4a22-8976-a9ece937dfe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a91e73-4977-4a22-8976-a9ece937dfe4', 'volume_size': 1} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a91e73-4977-4a22-8976-a9ece937dfe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ca434d4d814e26832ec3623a805553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:11Z,use_quota=True,user_id='872e56845ee748ef83dc0301a43816c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Creating volume 51a91e73-4977-4a22-8976-a9ece937dfe4 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:10 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:31:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a91e73-4977-4a22-8976-a9ece937dfe4 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:10 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a91e73-4977-4a22-8976-a9ece937dfe4 1073741824 Sep 23 00:31:10 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:11 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a91e73-4977-4a22-8976-a9ece937dfe4 1073741824" returned: 0 in 0.487s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a91e73-4977-4a22-8976-a9ece937dfe4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:11 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a91e73-4977-4a22-8976-a9ece937dfe4 Sep 23 00:31:11 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:11 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a91e73-4977-4a22-8976-a9ece937dfe4" returned: 0 in 0.292s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d540a8-b970-49ad-a137-14cdf79824fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a91e73-4977-4a22-8976-a9ece937dfe4', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b063bb-824f-4e4f-bd7c-ea5dbdc4f5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Volume volume-51a91e73-4977-4a22-8976-a9ece937dfe4 (51a91e73-4977-4a22-8976-a9ece937dfe4): created successfully Sep 23 00:31:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b063bb-824f-4e4f-bd7c-ea5dbdc4f5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Flow 'volume_create_manager' (734c0804-dc34-440d-a057-b260737d7771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:11 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d8cc7f4a-c68f-4d82-b15c-c90cd13e0e3e tempest-CinderUnicodeTest-1290851650 None] Created volume successfully. Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Flow 'volume_create_manager' (11f73c73-a2db-4bd9-98e2-3829341848a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (febcac39-bc67-46c5-8762-7534b3871c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (febcac39-bc67-46c5-8762-7534b3871c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1609010038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d04008b-89eb-4870-add9-55f431445df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ca434d4d814e26832ec3623a805553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:13Z,use_quota=True,user_id='872e56845ee748ef83dc0301a43816c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a1ec16-f0f5-4859-9a22-e1a253ef8959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a1ec16-f0f5-4859-9a22-e1a253ef8959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c95d4c-876a-47e3-8c19-65ac7e91491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c95d4c-876a-47e3-8c19-65ac7e91491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d04008b-89eb-4870-add9-55f431445df4', 'volume_name': 'volume-8d04008b-89eb-4870-add9-55f431445df4', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880fdf3a-e78f-464f-a805-d155de2d029b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880fdf3a-e78f-464f-a805-d155de2d029b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e957c8a2-a5af-40cf-8e43-9db94f5e4b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:13 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Volume 8d04008b-89eb-4870-add9-55f431445df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d04008b-89eb-4870-add9-55f431445df4', 'volume_size': 1} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1609010038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d04008b-89eb-4870-add9-55f431445df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ca434d4d814e26832ec3623a805553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:13Z,use_quota=True,user_id='872e56845ee748ef83dc0301a43816c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Creating volume 8d04008b-89eb-4870-add9-55f431445df4 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:13 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:31:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:13 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 1073741824 Sep 23 00:31:13 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:14 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 1073741824" returned: 0 in 0.734s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:14 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 Sep 23 00:31:14 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:14 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4" returned: 0 in 0.334s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e957c8a2-a5af-40cf-8e43-9db94f5e4b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d04008b-89eb-4870-add9-55f431445df4', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc0d3f7-9e43-4608-9317-c21c14cd2404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:14 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Volume volume-8d04008b-89eb-4870-add9-55f431445df4 (8d04008b-89eb-4870-add9-55f431445df4): created successfully Sep 23 00:31:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc0d3f7-9e43-4608-9317-c21c14cd2404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Flow 'volume_create_manager' (11f73c73-a2db-4bd9-98e2-3829341848a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:14 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-adc7c6aa-4877-48c0-87ad-8e882e60592a tempest-CinderUnicodeTest-1290851650 None] Created volume successfully. Sep 23 00:31:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] Creating offline snapshot 8acffbbc-f0e4-48e5-9b1f-f3062656490b of volume 8d04008b-89eb-4870-add9-55f431445df4 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:31:15 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fddbcef-05c2-4ac6-a943-8bc86bcfdcf0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:16 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 Sep 23 00:31:16 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:16 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4" returned: 0 in 0.394s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:16 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b 1G Sep 23 00:31:16 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:16 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b 1G" returned: 0 in 0.578s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d04008b-89eb-4870-add9-55f431445df4 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:16 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d04008b-89eb-4870-add9-55f431445df4 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b Sep 23 00:31:16 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:17 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d04008b-89eb-4870-add9-55f431445df4 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b" returned: 0 in 0.418s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:17 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b is being set with open permissions: ugo+rw Sep 23 00:31:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:17 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b Sep 23 00:31:17 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:17 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b" returned: 0 in 0.313s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:17 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.info Sep 23 00:31:17 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:18 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.info" returned: 0 in 0.346s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:18 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.info is being set with open permissions: ugo+rw Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:18 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.info Sep 23 00:31:18 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Flow 'volume_create_manager' (3907d5f3-b0bd-4337-b548-2602f4f45ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:18 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478c3edc-197d-4b2e-896a-398292111f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.info" returned: 0 in 0.316s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478c3edc-197d-4b2e-896a-398292111f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-895795878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8794877a-afe7-4abe-af83-75161da0fdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66297867147043b2b0a7649508d2bddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:18Z,use_quota=True,user_id='89186a1bba3540818296fc17b85adced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b97ff86-40a4-4e2b-801d-ea37fa868852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b97ff86-40a4-4e2b-801d-ea37fa868852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c23de5-bcff-4398-8a99-e552208afafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c23de5-bcff-4398-8a99-e552208afafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8794877a-afe7-4abe-af83-75161da0fdd5', 'volume_name': 'volume-8794877a-afe7-4abe-af83-75161da0fdd5', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd24c52d-e461-4504-9909-e15a2a95039e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd24c52d-e461-4504-9909-e15a2a95039e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22523e9-3da2-4402-a9de-858c4d7ad8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:18 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Volume 8794877a-afe7-4abe-af83-75161da0fdd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8794877a-afe7-4abe-af83-75161da0fdd5', 'volume_size': 1} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-895795878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8794877a-afe7-4abe-af83-75161da0fdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66297867147043b2b0a7649508d2bddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:18Z,use_quota=True,user_id='89186a1bba3540818296fc17b85adced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Creating volume 8794877a-afe7-4abe-af83-75161da0fdd5 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:18 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:18 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 1073741824 Sep 23 00:31:18 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:18 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a587e528-5fff-452c-8cce-097f2ea79f44 tempest-CinderUnicodeTest-1290851650 None] Create snapshot completed successfully Sep 23 00:31:18 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 1073741824" returned: 0 in 0.505s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:19 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 Sep 23 00:31:19 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "cinder-8acffbbc-f0e4-48e5-9b1f-f3062656490b-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-8acffbbc-f0e4-48e5-9b1f-f3062656490b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "cinder-quobyte-8d04008b-89eb-4870-add9-55f431445df4" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-quobyte-8d04008b-89eb-4870-add9-55f431445df4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "cinder-quobyte-8acffbbc-f0e4-48e5-9b1f-f3062656490b" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-quobyte-8acffbbc-f0e4-48e5-9b1f-f3062656490b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Deleting offline snapshot 8acffbbc-f0e4-48e5-9b1f-f3062656490b of volume 8d04008b-89eb-4870-add9-55f431445df4 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] snapshot_file for this snap is: volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f02a4d-1461-4ab8-8840-c28f0fc829da]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:19 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5" returned: 0 in 0.337s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:19 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b Sep 23 00:31:19 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22523e9-3da2-4402-a9de-858c4d7ad8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8794877a-afe7-4abe-af83-75161da0fdd5', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f337c682-a1e8-4e18-8861-1da996de0e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:19 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Volume volume-8794877a-afe7-4abe-af83-75161da0fdd5 (8794877a-afe7-4abe-af83-75161da0fdd5): created successfully Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f337c682-a1e8-4e18-8861-1da996de0e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Flow 'volume_create_manager' (3907d5f3-b0bd-4337-b548-2602f4f45ae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:19 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e5fe4ca5-c934-4221-8ef9-0c4c7e582e42 tempest-SnapshotDependencyTests-1801895662 None] Created volume successfully. Sep 23 00:31:19 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b" returned: 0 in 0.426s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d04008b-89eb-4870-add9-55f431445df4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[16be2e8f-4486-42e0-96fc-c8b79c7c6b24]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:19 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 Sep 23 00:31:19 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:20 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4" returned: 0 in 0.396s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:20 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b Sep 23 00:31:20 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:20 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b" returned: 0 in 0.409s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:20 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b Sep 23 00:31:20 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] Creating offline snapshot 7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 of volume 8794877a-afe7-4abe-af83-75161da0fdd5 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ded43c1-accd-4242-a0ef-38a0f6369831]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:20 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4.8acffbbc-f0e4-48e5-9b1f-f3062656490b" returned: 0 in 0.325s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-quobyte-8acffbbc-f0e4-48e5-9b1f-f3062656490b" released by "_delete_snapshot" :: held 1.709s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-quobyte-8d04008b-89eb-4870-add9-55f431445df4" released by "delete_snapshot" :: held 1.739s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:20 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 Sep 23 00:31:20 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:20 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Created reservations ['3525eec8-71a4-4b07-ba7c-6d8ed2f54b5a', '21152894-4aff-4ae4-b821-4833f78e891a', '13a6c98f-2030-47e4-a8a2-aad413727b19', 'de0416cd-1bd7-48c1-af02-9ecc2a5ce3d4'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Delete snapshot completed successfully. Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e4cbc874-e44d-4b54-b1be-801e96bd4dcb tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-8acffbbc-f0e4-48e5-9b1f-f3062656490b-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:21 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5" returned: 0 in 0.473s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:21 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 1G Sep 23 00:31:21 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "cinder-8d04008b-89eb-4870-add9-55f431445df4-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-8d04008b-89eb-4870-add9-55f431445df4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "cinder-quobyte-8d04008b-89eb-4870-add9-55f431445df4" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-quobyte-8d04008b-89eb-4870-add9-55f431445df4" acquired by "delete_volume" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d7d260-cefb-46fc-be4c-a0ba2061d6ad]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:21 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 Sep 23 00:31:21 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:21 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 1G" returned: 0 in 0.497s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8794877a-afe7-4abe-af83-75161da0fdd5 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:21 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8794877a-afe7-4abe-af83-75161da0fdd5 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 Sep 23 00:31:21 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:21 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4" returned: 0 in 0.412s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:21 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4 Sep 23 00:31:21 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:22 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8794877a-afe7-4abe-af83-75161da0fdd5 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5" returned: 0 in 0.355s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:22 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 is being set with open permissions: ugo+rw Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:22 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 Sep 23 00:31:22 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:22 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8d04008b-89eb-4870-add9-55f431445df4" returned: 0 in 0.302s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-quobyte-8d04008b-89eb-4870-add9-55f431445df4" released by "delete_volume" :: held 0.788s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Created reservations ['d5e49f73-a84e-4dd2-9cf7-d44a7641e411', '1cce5dd8-e15a-42f2-9bf9-7fb49f47ffd7', '8e3b41e5-780d-4c33-a009-f9e1ce59a65d', 'ed83aed4-18be-4103-bfe9-1e7bca40308d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:22 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5" returned: 0 in 0.305s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:22 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:31:22 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:22 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.info Sep 23 00:31:22 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "cinder-51a91e73-4977-4a22-8976-a9ece937dfe4-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-51a91e73-4977-4a22-8976-a9ece937dfe4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "cinder-quobyte-51a91e73-4977-4a22-8976-a9ece937dfe4" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-quobyte-51a91e73-4977-4a22-8976-a9ece937dfe4" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac177bd-159e-48f0-b6d4-212705a03aae]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:22 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a91e73-4977-4a22-8976-a9ece937dfe4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.320s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:22 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Deleted volume successfully. Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-7b71cbe8-4ad7-47e8-91bb-77695ce32540 tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-8d04008b-89eb-4870-add9-55f431445df4-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:22 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a91e73-4977-4a22-8976-a9ece937dfe4 Sep 23 00:31:22 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:22 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.info" returned: 0 in 0.396s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:22 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.info is being set with open permissions: ugo+rw Sep 23 00:31:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:22 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.info Sep 23 00:31:22 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:23 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.info" returned: 0 in 0.288s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.432s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:23 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a91e73-4977-4a22-8976-a9ece937dfe4" returned: 0 in 0.474s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a91e73-4977-4a22-8976-a9ece937dfe4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:23 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a91e73-4977-4a22-8976-a9ece937dfe4 Sep 23 00:31:23 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-12b50bfb-46c0-4611-8b9d-1707c71a80ac tempest-SnapshotDependencyTests-1801895662 None] Create snapshot completed successfully Sep 23 00:31:23 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a91e73-4977-4a22-8976-a9ece937dfe4" returned: 0 in 0.278s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-quobyte-51a91e73-4977-4a22-8976-a9ece937dfe4" released by "delete_volume" :: held 0.805s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Created reservations ['7b73850e-9d62-4561-a00e-fc45ec86ee51', '734ff4c3-51bd-421f-a532-483ec0306bb3', '259950ca-9f90-4f27-a39b-778d8379220c', '9bc4e586-4fc5-49ad-a800-228e108c209c'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:23 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:31:23 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:23 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.297s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Deleted volume successfully. Sep 23 00:31:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4b94bc57-4edb-4b30-ba30-e8bdf7e8cc1c tempest-CinderUnicodeTest-1290851650 None] Lock "cinder-51a91e73-4977-4a22-8976-a9ece937dfe4-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Flow 'volume_create_manager' (feb0cdf7-c813-439b-8dda-d9001136d53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0da23ab-07b0-45ff-bd2f-b6a55af6e9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0da23ab-07b0-45ff-bd2f-b6a55af6e9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60b206e-0678-48f2-86db-be09345df3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66297867147043b2b0a7649508d2bddd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:25Z,use_quota=True,user_id='89186a1bba3540818296fc17b85adced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98bf290-4bb3-47a5-8e51-b0985c74a4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98bf290-4bb3-47a5-8e51-b0985c74a4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b03e72c-99d8-4cd5-8147-5391c9e9a062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b03e72c-99d8-4cd5-8147-5391c9e9a062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd60b206e-0678-48f2-86db-be09345df3a3', 'volume_name': 'volume-d60b206e-0678-48f2-86db-be09345df3a3', 'volume_size': 1, 'snapshot_id': '7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e55ab78-160a-4983-9d1a-6d694bf7ed97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e55ab78-160a-4983-9d1a-6d694bf7ed97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84393d91-e625-440a-b8da-07c9fbcb2d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:24 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Volume d60b206e-0678-48f2-86db-be09345df3a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d60b206e-0678-48f2-86db-be09345df3a3', 'volume_size': 1, 'snapshot_id': '7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5'} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "cinder-quobyte-7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5-d60b206e-0678-48f2-86db-be09345df3a3" by "_create_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-quobyte-7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5-d60b206e-0678-48f2-86db-be09345df3a3" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Creating volume d60b206e-0678-48f2-86db-be09345df3a3 from snapshot 7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 {{(pid=86481) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "cinder-quobyte-d60b206e-0678-48f2-86db-be09345df3a3" by "_copy_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-quobyte-d60b206e-0678-48f2-86db-be09345df3a3" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] snapshot: 7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5, volume: d60b206e-0678-48f2-86db-be09345df3a3, {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c328fe-e9ca-4906-882f-fe65c49ec37c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:25 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 Sep 23 00:31:25 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:25 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5" returned: 0 in 0.525s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8794877a-afe7-4abe-af83-75161da0fdd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:31:25 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fe0596-ba46-45ff-acf6-35a1f4b2b526]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:25 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 Sep 23 00:31:25 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:25 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5" returned: 0 in 0.443s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:31:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Creating direct copy from snapshot {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:31:25 devstack cinder-volume[86481]: DEBUG cinder.utils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Path /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3 not found in is_blk_device check {{(pid=86481) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:31:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:25 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3 Sep 23 00:31:25 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:32 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3" returned: 0 in 6.373s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:32 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:31:32 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Converted 1024.00 MB image at 160.65 MB/s Sep 23 00:31:32 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3 is being set with open permissions: ugo+rw Sep 23 00:31:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:32 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3 Sep 23 00:31:32 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:32 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3" returned: 0 in 0.332s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-quobyte-d60b206e-0678-48f2-86db-be09345df3a3" released by "_copy_volume_from_snapshot" :: held 7.805s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:32 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-quobyte-7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5-d60b206e-0678-48f2-86db-be09345df3a3" released by "_create_volume_from_snapshot" :: held 7.880s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.903s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84393d91-e625-440a-b8da-07c9fbcb2d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60b206e-0678-48f2-86db-be09345df3a3', 'volume_size': 1, 'snapshot_id': '7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a58b13-6e5c-4bef-83d5-b400fc85a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:32 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Volume volume-d60b206e-0678-48f2-86db-be09345df3a3 (d60b206e-0678-48f2-86db-be09345df3a3): created successfully Sep 23 00:31:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a58b13-6e5c-4bef-83d5-b400fc85a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Flow 'volume_create_manager' (feb0cdf7-c813-439b-8dda-d9001136d53a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:32 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-420c2f8e-01a6-486a-8a93-ab6e6791f4a3 tempest-SnapshotDependencyTests-1801895662 None] Created volume successfully. Sep 23 00:31:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "cinder-7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "cinder-quobyte-8794877a-afe7-4abe-af83-75161da0fdd5" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-quobyte-8794877a-afe7-4abe-af83-75161da0fdd5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "cinder-quobyte-7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-quobyte-7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Deleting offline snapshot 7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 of volume 8794877a-afe7-4abe-af83-75161da0fdd5 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:31:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] snapshot_file for this snap is: volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:31:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[424e222b-cfc7-46f0-9c66-592cce2be5cb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:33 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 Sep 23 00:31:33 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:34 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5" returned: 0 in 0.397s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8794877a-afe7-4abe-af83-75161da0fdd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:31:34 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7a01b8-29ee-47ff-b163-c1c1ec8972cf]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:34 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 Sep 23 00:31:34 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:34 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5" returned: 0 in 0.548s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:34 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 Sep 23 00:31:34 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:35 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5" returned: 0 in 0.338s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:35 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5 Sep 23 00:31:35 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:35 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5.7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5" returned: 0 in 0.262s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-quobyte-7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5" released by "_delete_snapshot" :: held 1.660s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-quobyte-8794877a-afe7-4abe-af83-75161da0fdd5" released by "delete_snapshot" :: held 1.728s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:35 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Created reservations ['5244b068-899f-4ceb-9050-7f4bc3b2392a', '4a01bdb5-6eff-4e61-a008-64760b56a35e', '8b6d99b4-1aed-4ae3-85d2-19fefd6ac783', '28bab178-f4fc-4a35-ad01-6bb2c35923af'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:35 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Delete snapshot completed successfully. Sep 23 00:31:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d0f5410a-a6c6-4f2a-adbe-ccb712a5482f tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-7de8f9b4-5a2f-404f-b56f-c2b6c2fcb7e5-delete_snapshot" released by "delete_snapshot" :: held 1.863s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "cinder-8794877a-afe7-4abe-af83-75161da0fdd5-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-8794877a-afe7-4abe-af83-75161da0fdd5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "cinder-quobyte-8794877a-afe7-4abe-af83-75161da0fdd5" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-quobyte-8794877a-afe7-4abe-af83-75161da0fdd5" acquired by "delete_volume" :: waited 0.013s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3ee887-9e3c-4e34-8784-8b7d6f0491ed]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:36 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 Sep 23 00:31:36 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:36 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5" returned: 0 in 0.360s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:36 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5 Sep 23 00:31:36 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:36 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-8794877a-afe7-4abe-af83-75161da0fdd5" returned: 0 in 0.250s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-quobyte-8794877a-afe7-4abe-af83-75161da0fdd5" released by "delete_volume" :: held 0.678s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Created reservations ['4d021037-434d-4661-be43-2ced83fbfb2a', '3f0bbe98-72ef-4907-b572-b87f7bd06a88', '006f4b74-9bad-458a-8489-36607e401606', '09caaf3d-bb21-47b2-9e63-7d37d13f913c'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:36 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:31:36 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:37 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.281s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Deleted volume successfully. Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "cinder-d60b206e-0678-48f2-86db-be09345df3a3-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-885681cf-c3c6-4413-ba46-976a96c9173d tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-8794877a-afe7-4abe-af83-75161da0fdd5-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-d60b206e-0678-48f2-86db-be09345df3a3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "cinder-quobyte-d60b206e-0678-48f2-86db-be09345df3a3" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-quobyte-d60b206e-0678-48f2-86db-be09345df3a3" acquired by "delete_volume" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6508a280-ceb8-4f87-b15f-d524660e43dc]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:37 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3 Sep 23 00:31:37 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:37 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3" returned: 0 in 0.380s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:37 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3 Sep 23 00:31:37 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:37 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d60b206e-0678-48f2-86db-be09345df3a3" returned: 0 in 0.254s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-quobyte-d60b206e-0678-48f2-86db-be09345df3a3" released by "delete_volume" :: held 0.682s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Created reservations ['3b392a94-4b89-4456-a81c-821c9d21d8b6', '78f757ce-c29b-4d50-a0ce-d52eb9c7c72f', '85ec9b44-deac-42a9-a9c3-ee7212eb3dae', '051897c5-10af-4dc0-94dc-37a99abeb5ba'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:37 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:31:37 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:38 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.313s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:38 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:38 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Deleted volume successfully. Sep 23 00:31:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-88d3d110-c408-4e92-90bf-cba6bdd9b4d3 tempest-SnapshotDependencyTests-1801895662 None] Lock "cinder-d60b206e-0678-48f2-86db-be09345df3a3-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:31:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:45 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:31:45 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:45 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.285s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:31:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:31:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:31:47 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=67,cinder:SELECT=60,cinder:INSERT=20,cinder:DELETE=7 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:48 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=62,cinder:INSERT=25,cinder:UPDATE=75,cinder:DELETE=5 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Flow 'volume_create_manager' (a5eb6a11-98b9-4615-9dd1-39e22ff6756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aaf6550-286e-416a-a706-c88a0a325b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aaf6550-286e-416a-a706-c88a0a325b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141428878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4964cca3-f9fa-423c-8e82-0081a202f235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f92b9c08144fd8fba562d9d941033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:02Z,use_quota=True,user_id='e29c4fb262ff4665828c9fc0ba87f40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfa83b1-b7fd-400c-a717-6dd83b47de93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfa83b1-b7fd-400c-a717-6dd83b47de93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce76076-5215-47ee-866d-556841415361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce76076-5215-47ee-866d-556841415361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4964cca3-f9fa-423c-8e82-0081a202f235', 'volume_name': 'volume-4964cca3-f9fa-423c-8e82-0081a202f235', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd077194-747c-4653-b302-821520bc71e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd077194-747c-4653-b302-821520bc71e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7484f3a3-80f2-48fc-aba2-9c3601a32306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume 4964cca3-f9fa-423c-8e82-0081a202f235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4964cca3-f9fa-423c-8e82-0081a202f235', 'volume_size': 1} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141428878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4964cca3-f9fa-423c-8e82-0081a202f235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f92b9c08144fd8fba562d9d941033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:02Z,use_quota=True,user_id='e29c4fb262ff4665828c9fc0ba87f40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Creating volume 4964cca3-f9fa-423c-8e82-0081a202f235 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:02 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:02 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 1073741824 Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Flow 'volume_create_manager' (d586cfc1-fb23-4e50-915e-c667b0cfbf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:02 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e9716b-ad33-4c58-8efe-7e2a8279d57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e9716b-ad33-4c58-8efe-7e2a8279d57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-872216457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03d0b52-32b1-47bc-a9e1-8108b62108b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360c43e940ba44ec9174f3a572a037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:03Z,use_quota=True,user_id='935e78a65aad4c46857192d6337d0cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170b73ad-729a-4359-bb5a-63b056bbfe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170b73ad-729a-4359-bb5a-63b056bbfe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402159a6-29fb-43b9-82f1-2da71829201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402159a6-29fb-43b9-82f1-2da71829201c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03d0b52-32b1-47bc-a9e1-8108b62108b4', 'volume_name': 'volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf15c160-9c58-4b88-a1d3-0c2eaf455720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf15c160-9c58-4b88-a1d3-0c2eaf455720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625fe5b2-327c-47c6-9a0c-e1cf705c89c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Volume d03d0b52-32b1-47bc-a9e1-8108b62108b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4', 'volume_size': 1} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Flow 'volume_create_manager' (2ba01ef6-fa38-47d6-8811-586ff26a4348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeae2d99-d49d-49d4-85e7-df5594ae4337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeae2d99-d49d-49d4-85e7-df5594ae4337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1005405071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f4f047-ce61-44c5-8305-ecd2a36535c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360c43e940ba44ec9174f3a572a037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:03Z,use_quota=True,user_id='935e78a65aad4c46857192d6337d0cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c9d45c-f3b2-4a49-9dc1-a06efb4324c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c9d45c-f3b2-4a49-9dc1-a06efb4324c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18c09a4-dbcf-4b21-bbe4-685f2ebfa294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18c09a4-dbcf-4b21-bbe4-685f2ebfa294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01f4f047-ce61-44c5-8305-ecd2a36535c8', 'volume_name': 'volume-01f4f047-ce61-44c5-8305-ecd2a36535c8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd563b8-0bb7-441c-889b-da845e3e9d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd563b8-0bb7-441c-889b-da845e3e9d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70da8084-b8fd-489e-9dca-f472c279493a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:02 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Volume 01f4f047-ce61-44c5-8305-ecd2a36535c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01f4f047-ce61-44c5-8305-ecd2a36535c8', 'volume_size': 1} Sep 23 00:32:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Flow 'volume_create_manager' (d838f3b1-2cf6-4a12-acdc-ba995cdedf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55fe2a0e-d5ac-44b8-bf82-03bb50a9f446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55fe2a0e-d5ac-44b8-bf82-03bb50a9f446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-672914930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360c43e940ba44ec9174f3a572a037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:03Z,use_quota=True,user_id='935e78a65aad4c46857192d6337d0cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd80101-60a1-4c52-849e-2802a0ac2efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd80101-60a1-4c52-849e-2802a0ac2efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fea85b-cc4b-4eaf-8573-54f0419da88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fea85b-cc4b-4eaf-8573-54f0419da88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7', 'volume_name': 'volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6235d3dd-5055-4fa3-9594-eb14a768483e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6235d3dd-5055-4fa3-9594-eb14a768483e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d63cfa-bbdb-4bd6-b872-208fbe29c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:03 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Volume b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7', 'volume_size': 1} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:03 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 1073741824" returned: 0 in 0.784s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:03 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 Sep 23 00:32:03 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:03 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235" returned: 0 in 0.346s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-872216457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03d0b52-32b1-47bc-a9e1-8108b62108b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360c43e940ba44ec9174f3a572a037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:03Z,use_quota=True,user_id='935e78a65aad4c46857192d6337d0cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Creating volume d03d0b52-32b1-47bc-a9e1-8108b62108b4 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:03 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:03 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4 1073741824 Sep 23 00:32:03 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7484f3a3-80f2-48fc-aba2-9c3601a32306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4964cca3-f9fa-423c-8e82-0081a202f235', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999fd0e3-1ad9-41ff-97d1-d105d36e6bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:03 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume volume-4964cca3-f9fa-423c-8e82-0081a202f235 (4964cca3-f9fa-423c-8e82-0081a202f235): created successfully Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999fd0e3-1ad9-41ff-97d1-d105d36e6bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:03 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Flow 'volume_create_manager' (a5eb6a11-98b9-4615-9dd1-39e22ff6756d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:04 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6d507951-43d5-4cf9-82aa-3e3da4005279 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created volume successfully. Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Flow 'volume_create_manager' (f7354d23-de2f-48ce-bcb0-657bf0efc1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cdc20a-a3c7-4de0-bab6-3ed89c16bef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18cdc20a-a3c7-4de0-bab6-3ed89c16bef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333355426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f20fe2-cd47-4a77-ad97-aa6915d0a016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360c43e940ba44ec9174f3a572a037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:04Z,use_quota=True,user_id='935e78a65aad4c46857192d6337d0cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34945587-59dd-4140-a952-edd7e8ab7ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34945587-59dd-4140-a952-edd7e8ab7ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23d9888-2d3f-4d06-a458-983a3ee05528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23d9888-2d3f-4d06-a458-983a3ee05528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f20fe2-cd47-4a77-ad97-aa6915d0a016', 'volume_name': 'volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fac7a75-a276-4846-90f4-c15be8d99a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fac7a75-a276-4846-90f4-c15be8d99a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5ecc32-3ed8-4830-9ed6-c6bb6cc7c68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:04 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Volume 23f20fe2-cd47-4a77-ad97-aa6915d0a016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016', 'volume_size': 1} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:04 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4 1073741824" returned: 0 in 0.865s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:04 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4 Sep 23 00:32:04 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Flow 'volume_create_manager' (371180e8-ebe6-4f28-a262-70d4abb1c381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc68bdb-1c12-48f3-84b8-f8ef945e0af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc68bdb-1c12-48f3-84b8-f8ef945e0af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1171049019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767788a7-24ef-41d4-8237-86eeedd677eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360c43e940ba44ec9174f3a572a037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:05Z,use_quota=True,user_id='935e78a65aad4c46857192d6337d0cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323a203a-c32b-4b35-98ca-f3950da0d8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323a203a-c32b-4b35-98ca-f3950da0d8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e610055-8e95-436c-9ac2-abc52bcffdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e610055-8e95-436c-9ac2-abc52bcffdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '767788a7-24ef-41d4-8237-86eeedd677eb', 'volume_name': 'volume-767788a7-24ef-41d4-8237-86eeedd677eb', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dafdf8a-e37b-4b7a-b279-132dd1954a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dafdf8a-e37b-4b7a-b279-132dd1954a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5dbbcfc-1785-4aa5-8fa8-8204deace1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Volume 767788a7-24ef-41d4-8237-86eeedd677eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-767788a7-24ef-41d4-8237-86eeedd677eb', 'volume_size': 1} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:05 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4" returned: 0 in 0.407s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.216s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1005405071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f4f047-ce61-44c5-8305-ecd2a36535c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360c43e940ba44ec9174f3a572a037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:03Z,use_quota=True,user_id='935e78a65aad4c46857192d6337d0cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Creating volume 01f4f047-ce61-44c5-8305-ecd2a36535c8 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:05 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-01f4f047-ce61-44c5-8305-ecd2a36535c8 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:05 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-01f4f047-ce61-44c5-8305-ecd2a36535c8 1073741824 Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625fe5b2-327c-47c6-9a0c-e1cf705c89c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31e607e-921a-4aee-a072-cb5ea4560eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Volume volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4 (d03d0b52-32b1-47bc-a9e1-8108b62108b4): created successfully Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31e607e-921a-4aee-a072-cb5ea4560eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Flow 'volume_create_manager' (d586cfc1-fb23-4e50-915e-c667b0cfbf72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7c202c77-8c89-46d1-8303-63f4cb96dd72 tempest-CreateVolumesFromImageTest-99230566 None] Created volume successfully. Sep 23 00:32:05 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-01f4f047-ce61-44c5-8305-ecd2a36535c8 1073741824" returned: 0 in 0.663s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-01f4f047-ce61-44c5-8305-ecd2a36535c8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:06 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-01f4f047-ce61-44c5-8305-ecd2a36535c8 Sep 23 00:32:06 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:06 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-01f4f047-ce61-44c5-8305-ecd2a36535c8" returned: 0 in 0.277s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.914s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-672914930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360c43e940ba44ec9174f3a572a037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:03Z,use_quota=True,user_id='935e78a65aad4c46857192d6337d0cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Creating volume b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:06 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70da8084-b8fd-489e-9dca-f472c279493a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f4f047-ce61-44c5-8305-ecd2a36535c8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7 1073741824 Sep 23 00:32:06 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bef6a07-bd30-41e8-98ad-0f7b824d7119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Volume volume-01f4f047-ce61-44c5-8305-ecd2a36535c8 (01f4f047-ce61-44c5-8305-ecd2a36535c8): created successfully Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bef6a07-bd30-41e8-98ad-0f7b824d7119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Flow 'volume_create_manager' (2ba01ef6-fa38-47d6-8811-586ff26a4348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:06 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-648312ca-aa39-47ce-8cbd-ca3c10e4b38a tempest-CreateVolumesFromImageTest-99230566 None] Created volume successfully. Sep 23 00:32:07 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7 1073741824" returned: 0 in 0.738s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:07 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7 Sep 23 00:32:07 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:07 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7" returned: 0 in 0.293s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.219s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333355426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f20fe2-cd47-4a77-ad97-aa6915d0a016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360c43e940ba44ec9174f3a572a037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:04Z,use_quota=True,user_id='935e78a65aad4c46857192d6337d0cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Creating volume 23f20fe2-cd47-4a77-ad97-aa6915d0a016 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:07 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d63cfa-bbdb-4bd6-b872-208fbe29c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:07 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016 1073741824 Sep 23 00:32:07 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e338fd13-3fc8-4d6f-aef0-5af29c2f2018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:07 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Volume volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7 (b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7): created successfully Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e338fd13-3fc8-4d6f-aef0-5af29c2f2018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:07 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Flow 'volume_create_manager' (d838f3b1-2cf6-4a12-acdc-ba995cdedf50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:07 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c7ca4ab1-ce45-4812-97cd-a2e8060f7501 tempest-CreateVolumesFromImageTest-99230566 None] Created volume successfully. Sep 23 00:32:08 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016 1073741824" returned: 0 in 0.625s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:08 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016 Sep 23 00:32:08 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Flow 'volume_create_manager' (52995207-e81f-4828-933f-78c18c368fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157ebdb2-6897-4fdc-b872-85ea9498665f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157ebdb2-6897-4fdc-b872-85ea9498665f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c118b0a-b773-4920-aaa0-b20a38cd3a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f528c45324366a04982c2927aa27c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:08Z,use_quota=True,user_id='450b6dd37b9d446aa124cb3b886860cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d969f9ef-2858-4c17-8a6b-895e14ad80d9),volume_type_id=d969f9ef-2858-4c17-8a6b-895e14ad80d9)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ede013-db10-4c13-8520-26dd786953fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ede013-db10-4c13-8520-26dd786953fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e22f88af-0656-4b4a-8ba9-e628d28e25dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.image.glance [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Creating Keystone auth plugin from conf {{(pid=86481) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:32:08 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016" returned: 0 in 0.345s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.692s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5ecc32-3ed8-4830-9ed6-c6bb6cc7c68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c797eca-9800-4273-a14e-fe4bf69d3ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Creating offline snapshot 1fd6632f-0349-40c2-8a44-309b134dc7bf of volume 4964cca3-f9fa-423c-8e82-0081a202f235 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:08 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Volume volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016 (23f20fe2-cd47-4a77-ad97-aa6915d0a016): created successfully Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c797eca-9800-4273-a14e-fe4bf69d3ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Flow 'volume_create_manager' (f7354d23-de2f-48ce-bcb0-657bf0efc1cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a3d54c-a359-4d84-a402-1643da439c21]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:08 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d6ff646f-e001-41fb-b530-25657c29292c tempest-CreateVolumesFromImageTest-99230566 None] Created volume successfully. Sep 23 00:32:08 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 Sep 23 00:32:08 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e22f88af-0656-4b4a-8ba9-e628d28e25dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c118b0a-b773-4920-aaa0-b20a38cd3a63', 'volume_name': 'volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63', 'volume_size': 1, 'image_id': 'bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b9106efcd010b799adfd573dc915be76', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a7f528c45324366a04982c2927aa27c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f4f3dd5d2cefe68252fb2f53c378fd9578e6796ff75b9e324f1a185e2c02f7fb979b46b3393155182ad79306dedba6324a1b3a8746a59202e3397004e0f3e90', 'id': 'bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'created_at': datetime.datetime(2026, 9, 22, 22, 32, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 32, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf8f4aa2-f933-4b8d-b3a5-7e3784796a43/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894eb381-d9db-490b-9901-6dc9e7e04044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894eb381-d9db-490b-9901-6dc9e7e04044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b6ba09-3915-4ecf-9197-7ab2791ddec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:08 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Volume 2c118b0a-b773-4920-aaa0-b20a38cd3a63: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63', 'volume_size': 1, 'image_id': 'bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b9106efcd010b799adfd573dc915be76', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a7f528c45324366a04982c2927aa27c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f4f3dd5d2cefe68252fb2f53c378fd9578e6796ff75b9e324f1a185e2c02f7fb979b46b3393155182ad79306dedba6324a1b3a8746a59202e3397004e0f3e90', 'id': 'bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'created_at': datetime.datetime(2026, 9, 22, 22, 32, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 32, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf8f4aa2-f933-4b8d-b3a5-7e3784796a43/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Trying to clone 2c118b0a-b773-4920-aaa0-b20a38cd3a63 from image bf8f4aa2-f933-4b8d-b3a5-7e3784796a43 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'metadata': {}}]). {{(pid=86481) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:32:08 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1da605-b250-423c-a13d-ee78adaa2046]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:08 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235" returned: 0 in 0.469s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:09 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf 1G Sep 23 00:32:09 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:09 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD Sep 23 00:32:09 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:09 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:09 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD Sep 23 00:32:09 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:09 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf 1G" returned: 0 in 0.508s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4964cca3-f9fa-423c-8e82-0081a202f235 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:09 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4964cca3-f9fa-423c-8e82-0081a202f235 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf Sep 23 00:32:09 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:09 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:32:09 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Temporary image bf8f4aa2-f933-4b8d-b3a5-7e3784796a43 is fetched for user 450b6dd37b9d446aa124cb3b886860cb. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:32:09 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[614902cd-05ce-4902-97c3-f1aecbb49363]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:09 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4964cca3-f9fa-423c-8e82-0081a202f235 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf" returned: 0 in 0.389s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:09 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf is being set with open permissions: ugo+rw Sep 23 00:32:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:09 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf Sep 23 00:32:09 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:09 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD Sep 23 00:32:09 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:10 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:10 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf" returned: 0 in 0.292s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:10 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.info Sep 23 00:32:10 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:10 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD Sep 23 00:32:10 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:10 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.info" returned: 0 in 0.302s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:10 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.info is being set with open permissions: ugo+rw Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:10 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.info Sep 23 00:32:10 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:10 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD" returned: 1 in 0.388s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:10 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.info" returned: 0 in 0.270s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.689s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1171049019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767788a7-24ef-41d4-8237-86eeedd677eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360c43e940ba44ec9174f3a572a037d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:05Z,use_quota=True,user_id='935e78a65aad4c46857192d6337d0cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Creating volume 767788a7-24ef-41d4-8237-86eeedd677eb {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:10 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-767788a7-24ef-41d4-8237-86eeedd677eb 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:10 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-767788a7-24ef-41d4-8237-86eeedd677eb 1073741824 Sep 23 00:32:10 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:10 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-36652525-03dd-460f-b68d-cb4f004693b3 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Create snapshot completed successfully Sep 23 00:32:11 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-767788a7-24ef-41d4-8237-86eeedd677eb 1073741824" returned: 0 in 0.567s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-767788a7-24ef-41d4-8237-86eeedd677eb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:11 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-767788a7-24ef-41d4-8237-86eeedd677eb Sep 23 00:32:11 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:11 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-767788a7-24ef-41d4-8237-86eeedd677eb" returned: 0 in 0.286s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.184s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c118b0a-b773-4920-aaa0-b20a38cd3a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f528c45324366a04982c2927aa27c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:08Z,use_quota=True,user_id='450b6dd37b9d446aa124cb3b886860cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d969f9ef-2858-4c17-8a6b-895e14ad80d9),volume_type_id=d969f9ef-2858-4c17-8a6b-895e14ad80d9)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Creating volume 2c118b0a-b773-4920-aaa0-b20a38cd3a63 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:11 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5dbbcfc-1785-4aa5-8fa8-8204deace1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-767788a7-24ef-41d4-8237-86eeedd677eb', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:11 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 1073741824 Sep 23 00:32:11 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7132256c-ed39-4b1a-a2e8-700edd605f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Volume volume-767788a7-24ef-41d4-8237-86eeedd677eb (767788a7-24ef-41d4-8237-86eeedd677eb): created successfully Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7132256c-ed39-4b1a-a2e8-700edd605f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Flow 'volume_create_manager' (371180e8-ebe6-4f28-a262-70d4abb1c381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:11 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c5c580e0-cf44-4661-9e48-5b684fcb6533 tempest-CreateVolumesFromImageTest-99230566 None] Created volume successfully. Sep 23 00:32:12 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 1073741824" returned: 0 in 0.598s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:12 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 Sep 23 00:32:12 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "cinder-767788a7-24ef-41d4-8237-86eeedd677eb-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Flow 'volume_create_manager' (17571b33-5248-48e3-9cee-0a0491b195fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:12 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd205e26-0ea1-4eff-b437-077617ee4ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-767788a7-24ef-41d4-8237-86eeedd677eb-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63" returned: 0 in 0.412s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd205e26-0ea1-4eff-b437-077617ee4ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894796930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0375a450-e51c-499d-905f-f7ac3c3453b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f92b9c08144fd8fba562d9d941033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:13Z,use_quota=True,user_id='e29c4fb262ff4665828c9fc0ba87f40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80566c1-b6ca-4f4a-8924-1db0ec986b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80566c1-b6ca-4f4a-8924-1db0ec986b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef17f846-1734-462c-9fcd-0db51ae49a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef17f846-1734-462c-9fcd-0db51ae49a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0375a450-e51c-499d-905f-f7ac3c3453b3', 'volume_name': 'volume-0375a450-e51c-499d-905f-f7ac3c3453b3', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6deb55-756d-4d4f-a25a-6150033fbae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6deb55-756d-4d4f-a25a-6150033fbae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628a35f4-6953-4f2a-90cb-8eef761559bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:12 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume 0375a450-e51c-499d-905f-f7ac3c3453b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0375a450-e51c-499d-905f-f7ac3c3453b3', 'volume_size': 1} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894796930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0375a450-e51c-499d-905f-f7ac3c3453b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f92b9c08144fd8fba562d9d941033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:13Z,use_quota=True,user_id='e29c4fb262ff4665828c9fc0ba87f40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Creating volume 0375a450-e51c-499d-905f-f7ac3c3453b3 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:12 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0375a450-e51c-499d-905f-f7ac3c3453b3 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:12 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0375a450-e51c-499d-905f-f7ac3c3453b3 1073741824 Sep 23 00:32:12 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:12 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Attempting download of bf8f4aa2-f933-4b8d-b3a5-7e3784796a43 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'metadata': {}}])) to volume 2c118b0a-b773-4920-aaa0-b20a38cd3a63. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "cinder-quobyte-767788a7-24ef-41d4-8237-86eeedd677eb" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-quobyte-767788a7-24ef-41d4-8237-86eeedd677eb" acquired by "delete_volume" :: waited 0.041s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0edafd-e9f5-4a78-8ce0-e4a4a424b3fa]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-767788a7-24ef-41d4-8237-86eeedd677eb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[4debf412-9614-42ad-9b9c-96acb7560059]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_uyvg4kyo {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:13 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-767788a7-24ef-41d4-8237-86eeedd677eb Sep 23 00:32:13 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:13 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_uyvg4kyo Sep 23 00:32:13 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Flow 'volume_create_manager' (75203344-d08a-4408-99bd-8f01cecf8731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f5e245-6723-495d-9791-7421492eb8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f5e245-6723-495d-9791-7421492eb8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640809395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddb6f27-fd97-43ae-bf76-4a9216eb4058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f92b9c08144fd8fba562d9d941033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:13Z,use_quota=True,user_id='e29c4fb262ff4665828c9fc0ba87f40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306f3e2b-f3d0-4f6c-a644-86d08fe36cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306f3e2b-f3d0-4f6c-a644-86d08fe36cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79e5914-9a14-45c2-99d4-84ff0d4961b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79e5914-9a14-45c2-99d4-84ff0d4961b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ddb6f27-fd97-43ae-bf76-4a9216eb4058', 'volume_name': 'volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8dc7ff-a770-4c5b-ac81-c20dc3f573a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8dc7ff-a770-4c5b-ac81-c20dc3f573a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1097ae-70b3-4ce4-95ac-2b6ac6dd8e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:13 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume 7ddb6f27-fd97-43ae-bf76-4a9216eb4058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058', 'volume_size': 1} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Flow 'volume_create_manager' (fdb1997e-bf4f-4f81-9f27-7260e0b61e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb345c07-3070-4cf8-bc6f-f5bc875014e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:13 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb345c07-3070-4cf8-bc6f-f5bc875014e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048164060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62392bbd-d8ac-4e06-820c-43b5324021a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f92b9c08144fd8fba562d9d941033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:14Z,use_quota=True,user_id='e29c4fb262ff4665828c9fc0ba87f40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4705d52f-4f64-4f2a-babc-4dea996c7164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4705d52f-4f64-4f2a-babc-4dea996c7164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc90d29f-12ee-4cc3-b4b0-a917e56af468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:13 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc90d29f-12ee-4cc3-b4b0-a917e56af468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62392bbd-d8ac-4e06-820c-43b5324021a8', 'volume_name': 'volume-62392bbd-d8ac-4e06-820c-43b5324021a8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a476c22-fe06-4a22-93ec-350ece70088f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:13 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:13 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a476c22-fe06-4a22-93ec-350ece70088f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e880ba-d4c6-4fa9-a5d3-03b0fea2413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:14 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume 62392bbd-d8ac-4e06-820c-43b5324021a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62392bbd-d8ac-4e06-820c-43b5324021a8', 'volume_size': 1} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_uyvg4kyo" returned: 0 in 0.838s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-767788a7-24ef-41d4-8237-86eeedd677eb" returned: 0 in 0.900s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0375a450-e51c-499d-905f-f7ac3c3453b3 1073741824" returned: 0 in 1.072s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_uyvg4kyo {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-767788a7-24ef-41d4-8237-86eeedd677eb {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:14 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-767788a7-24ef-41d4-8237-86eeedd677eb Sep 23 00:32:14 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0375a450-e51c-499d-905f-f7ac3c3453b3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:14 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0375a450-e51c-499d-905f-f7ac3c3453b3 Sep 23 00:32:14 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:14 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_uyvg4kyo Sep 23 00:32:14 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:14 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-767788a7-24ef-41d4-8237-86eeedd677eb" returned: 0 in 0.350s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-quobyte-767788a7-24ef-41d4-8237-86eeedd677eb" released by "delete_volume" :: held 1.357s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:14 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0375a450-e51c-499d-905f-f7ac3c3453b3" returned: 0 in 0.340s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.608s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640809395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddb6f27-fd97-43ae-bf76-4a9216eb4058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f92b9c08144fd8fba562d9d941033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:13Z,use_quota=True,user_id='e29c4fb262ff4665828c9fc0ba87f40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Creating volume 7ddb6f27-fd97-43ae-bf76-4a9216eb4058 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:14 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:14 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058 1073741824 Sep 23 00:32:14 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628a35f4-6953-4f2a-90cb-8eef761559bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0375a450-e51c-499d-905f-f7ac3c3453b3', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3634da-8893-4829-8076-ba441550980f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:14 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume volume-0375a450-e51c-499d-905f-f7ac3c3453b3 (0375a450-e51c-499d-905f-f7ac3c3453b3): created successfully Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3634da-8893-4829-8076-ba441550980f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Flow 'volume_create_manager' (17571b33-5248-48e3-9cee-0a0491b195fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:14 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_uyvg4kyo" returned: 1 in 0.641s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_uyvg4kyo' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ad0cdc-5022-4ea2-8ff1-538b578b7edb]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:14 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-8bb01431-6ca7-477f-987f-382ade13d0eb tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created volume successfully. Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Flow 'volume_create_manager' (0dbd77ea-6a17-4776-8050-15a9b8609489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6c3e64-ec66-4f18-843a-a561f41f091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6c3e64-ec66-4f18-843a-a561f41f091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1732790687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ca14d9-e381-49b8-a06c-59f87989c345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f92b9c08144fd8fba562d9d941033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:15Z,use_quota=True,user_id='e29c4fb262ff4665828c9fc0ba87f40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f00778-fe51-456f-b299-37f0235939df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f00778-fe51-456f-b299-37f0235939df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:14 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD Sep 23 00:32:14 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f006f849-6aa8-4211-9300-abf96952caa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f006f849-6aa8-4211-9300-abf96952caa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ca14d9-e381-49b8-a06c-59f87989c345', 'volume_name': 'volume-13ca14d9-e381-49b8-a06c-59f87989c345', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8daa146-8af9-42f9-9af8-87c9579691e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8daa146-8af9-42f9-9af8-87c9579691e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862e74cf-1c60-40fb-ae66-690d97936af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:14 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume 13ca14d9-e381-49b8-a06c-59f87989c345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ca14d9-e381-49b8-a06c-59f87989c345', 'volume_size': 1} Sep 23 00:32:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Created reservations ['bf771893-7132-4160-abcf-cfed253d0830', 'fbd8f197-5bf6-4321-87c9-616dae19d36b', '5cdd1833-c6b1-41dd-bf41-7042db8eb1cd', '272c1a3a-99d0-4430-8dac-3a3de8e666ee'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:15 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:15 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD" returned: 0 in 0.687s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058 1073741824" returned: 0 in 0.953s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058 Sep 23 00:32:15 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:15 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD Sep 23 00:32:15 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:15 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.487s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:15 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Deleted volume successfully. Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Flow 'volume_create_manager' (5ebd02d4-7c96-41e3-a729-52ca11e39777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ce572f-bc89-49d9-b60b-f551c3ca5fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-da07b3e7-31dc-4923-b0f4-5c76127fdf9f tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-767788a7-24ef-41d4-8237-86eeedd677eb-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ce572f-bc89-49d9-b60b-f551c3ca5fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2033100455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a43d7d-be19-40be-8eeb-4aa6d6a39f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f92b9c08144fd8fba562d9d941033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:16Z,use_quota=True,user_id='e29c4fb262ff4665828c9fc0ba87f40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a37288e-63bd-439b-aab2-272f5cd1b796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a37288e-63bd-439b-aab2-272f5cd1b796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d984a90-7b50-4549-b3a7-043a3dfc99cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d984a90-7b50-4549-b3a7-043a3dfc99cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3a43d7d-be19-40be-8eeb-4aa6d6a39f61', 'volume_name': 'volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b361b48-b6bc-4ea2-babd-838725fd8f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b361b48-b6bc-4ea2-babd-838725fd8f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae10b4e1-9b32-49dc-932e-d35fcfeda338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:15 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume c3a43d7d-be19-40be-8eeb-4aa6d6a39f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61', 'volume_size': 1} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:15 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD" returned: 1 in 0.537s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] bf8f4aa2-f933-4b8d-b3a5-7e3784796a43 was raw, converting to qcow2 {{(pid=86481) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:32:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:15 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 Sep 23 00:32:15 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058" returned: 0 in 0.561s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.048s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048164060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62392bbd-d8ac-4e06-820c-43b5324021a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f92b9c08144fd8fba562d9d941033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:14Z,use_quota=True,user_id='e29c4fb262ff4665828c9fc0ba87f40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Creating volume 62392bbd-d8ac-4e06-820c-43b5324021a8 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:16 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-62392bbd-d8ac-4e06-820c-43b5324021a8 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:16 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-62392bbd-d8ac-4e06-820c-43b5324021a8 1073741824 Sep 23 00:32:16 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1097ae-70b3-4ce4-95ac-2b6ac6dd8e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8647c8-55e6-4552-93df-2d3a050948c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:16 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058 (7ddb6f27-fd97-43ae-bf76-4a9216eb4058): created successfully Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8647c8-55e6-4552-93df-2d3a050948c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Flow 'volume_create_manager' (75203344-d08a-4408-99bd-8f01cecf8731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-adc078a8-b779-4e2c-a497-93361dbbc833 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created volume successfully. Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "cinder-23f20fe2-cd47-4a77-ad97-aa6915d0a016-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-23f20fe2-cd47-4a77-ad97-aa6915d0a016-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "cinder-quobyte-23f20fe2-cd47-4a77-ad97-aa6915d0a016" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-quobyte-23f20fe2-cd47-4a77-ad97-aa6915d0a016" acquired by "delete_volume" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Flow 'volume_create_manager' (c378bdd6-bf58-48cc-a99e-a2590dde63f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb5e755-3e9d-4692-b2d7-d36cd697627e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c977723-9793-401d-bfc0-013f26efd56a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb5e755-3e9d-4692-b2d7-d36cd697627e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-534603919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7819dbca-3342-419d-9466-672b245db9c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b2dc3b9f7145a3ad3285542169a74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:16Z,use_quota=True,user_id='cc49c0a6d4e24be187ecdd3e940c22f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2383058-4bf3-4ecc-a5d7-580027ffd15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2383058-4bf3-4ecc-a5d7-580027ffd15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22de1dfb-397f-413e-9cd6-8b8dedaa6e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22de1dfb-397f-413e-9cd6-8b8dedaa6e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7819dbca-3342-419d-9466-672b245db9c5', 'volume_name': 'volume-7819dbca-3342-419d-9466-672b245db9c5', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4321a720-8597-4fb1-9176-e763bd9622ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4321a720-8597-4fb1-9176-e763bd9622ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff5c1a1-4b3e-4d26-a88e-897a29e90086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:16 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Volume 7819dbca-3342-419d-9466-672b245db9c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7819dbca-3342-419d-9466-672b245db9c5', 'volume_size': 1} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:16 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63" returned: 0 in 0.716s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bf8f4aa2-f933-4b8d-b3a5-7e3784796a43_g3amfgajdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:32:16 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:16 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016 Sep 23 00:32:16 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 1G Sep 23 00:32:16 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-62392bbd-d8ac-4e06-820c-43b5324021a8 1073741824" returned: 0 in 0.697s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-62392bbd-d8ac-4e06-820c-43b5324021a8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:16 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-62392bbd-d8ac-4e06-820c-43b5324021a8 Sep 23 00:32:16 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:16 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016" returned: 0 in 0.500s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:17 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016 Sep 23 00:32:17 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:17 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 1G" returned: 0 in 0.424s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Downloaded image bf8f4aa2-f933-4b8d-b3a5-7e3784796a43 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'metadata': {}}])) to volume 2c118b0a-b773-4920-aaa0-b20a38cd3a63 successfully. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Temporary image bf8f4aa2-f933-4b8d-b3a5-7e3784796a43 for user 450b6dd37b9d446aa124cb3b886860cb is deleted. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Marking volume 2c118b0a-b773-4920-aaa0-b20a38cd3a63 as bootable. {{(pid=86481) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Copying metadata from image bf8f4aa2-f933-4b8d-b3a5-7e3784796a43 to 2c118b0a-b773-4920-aaa0-b20a38cd3a63. {{(pid=86481) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Creating volume glance metadata for volume 2c118b0a-b773-4920-aaa0-b20a38cd3a63 backed by image bf8f4aa2-f933-4b8d-b3a5-7e3784796a43 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b9106efcd010b799adfd573dc915be76', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86481) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:32:17 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-62392bbd-d8ac-4e06-820c-43b5324021a8" returned: 0 in 0.329s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.170s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1732790687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ca14d9-e381-49b8-a06c-59f87989c345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f92b9c08144fd8fba562d9d941033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:15Z,use_quota=True,user_id='e29c4fb262ff4665828c9fc0ba87f40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Creating volume 13ca14d9-e381-49b8-a06c-59f87989c345 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:17 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-13ca14d9-e381-49b8-a06c-59f87989c345 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b6ba09-3915-4ecf-9197-7ab2791ddec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63', 'volume_size': 1, 'image_id': 'bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b9106efcd010b799adfd573dc915be76', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a7f528c45324366a04982c2927aa27c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f4f3dd5d2cefe68252fb2f53c378fd9578e6796ff75b9e324f1a185e2c02f7fb979b46b3393155182ad79306dedba6324a1b3a8746a59202e3397004e0f3e90', 'id': 'bf8f4aa2-f933-4b8d-b3a5-7e3784796a43', 'created_at': datetime.datetime(2026, 9, 22, 22, 32, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 32, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf8f4aa2-f933-4b8d-b3a5-7e3784796a43/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:17 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-13ca14d9-e381-49b8-a06c-59f87989c345 1073741824 Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829be9c7-1f5d-4814-bbce-8f25a95b592d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:17 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e880ba-d4c6-4fa9-a5d3-03b0fea2413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62392bbd-d8ac-4e06-820c-43b5324021a8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f7aae9-d283-4332-968e-298468069c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:17 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume volume-62392bbd-d8ac-4e06-820c-43b5324021a8 (62392bbd-d8ac-4e06-820c-43b5324021a8): created successfully Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f7aae9-d283-4332-968e-298468069c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Flow 'volume_create_manager' (fdb1997e-bf4f-4f81-9f27-7260e0b61e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:17 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Volume volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 (2c118b0a-b773-4920-aaa0-b20a38cd3a63): created successfully Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829be9c7-1f5d-4814-bbce-8f25a95b592d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Flow 'volume_create_manager' (52995207-e81f-4828-933f-78c18c368fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-a66c1cf4-acfe-47e4-8882-15af296f4e66 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created volume successfully. Sep 23 00:32:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d2a97b0a-dc8e-4dbf-bf52-0a57a173f3d6 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Created volume successfully. Sep 23 00:32:17 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-23f20fe2-cd47-4a77-ad97-aa6915d0a016" returned: 0 in 0.331s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-quobyte-23f20fe2-cd47-4a77-ad97-aa6915d0a016" released by "delete_volume" :: held 0.930s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Created reservations ['29fd9a37-fad6-4db0-b7d4-5f0a1fd0edc9', '5c13c44a-6dc1-4ace-8dbd-abf0b54782ec', 'a30dadf3-1b32-47bd-abed-c2b63a6c4f9b', 'bc5677d5-ca2f-4372-bfd9-9748d47bb9a2'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:17 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:17 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:17 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-13ca14d9-e381-49b8-a06c-59f87989c345 1073741824" returned: 0 in 0.562s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-13ca14d9-e381-49b8-a06c-59f87989c345 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:17 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.287s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Deleted volume successfully. Sep 23 00:32:17 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-13ca14d9-e381-49b8-a06c-59f87989c345 Sep 23 00:32:17 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-91664646-e800-47c9-8e0b-8ee70d2ae1d6 tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-23f20fe2-cd47-4a77-ad97-aa6915d0a016-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:18 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-13ca14d9-e381-49b8-a06c-59f87989c345" returned: 0 in 0.292s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.246s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2033100455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3a43d7d-be19-40be-8eeb-4aa6d6a39f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f92b9c08144fd8fba562d9d941033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:16Z,use_quota=True,user_id='e29c4fb262ff4665828c9fc0ba87f40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Creating volume c3a43d7d-be19-40be-8eeb-4aa6d6a39f61 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:18 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862e74cf-1c60-40fb-ae66-690d97936af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ca14d9-e381-49b8-a06c-59f87989c345', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:18 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61 1073741824 Sep 23 00:32:18 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d5bfac-9173-48e7-a472-c51107c070b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:18 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume volume-13ca14d9-e381-49b8-a06c-59f87989c345 (13ca14d9-e381-49b8-a06c-59f87989c345): created successfully Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d5bfac-9173-48e7-a472-c51107c070b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Flow 'volume_create_manager' (0dbd77ea-6a17-4776-8050-15a9b8609489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Acquiring lock "cinder-2c118b0a-b773-4920-aaa0-b20a38cd3a63-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:18 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f5903a01-b93f-4565-a694-b8876ea4c5ba tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created volume successfully. Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Lock "cinder-2c118b0a-b773-4920-aaa0-b20a38cd3a63-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Acquiring lock "cinder-quobyte-2c118b0a-b773-4920-aaa0-b20a38cd3a63" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Lock "cinder-quobyte-2c118b0a-b773-4920-aaa0-b20a38cd3a63" acquired by "delete_volume" :: waited 0.016s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[da84369b-0457-404d-ab70-3af1e47c74c8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:18 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 Sep 23 00:32:18 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "cinder-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:18 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61 1073741824" returned: 0 in 0.571s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "cinder-quobyte-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-quobyte-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7" acquired by "delete_volume" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:18 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:18 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61 Sep 23 00:32:18 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63" returned: 0 in 0.497s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:18 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63 Sep 23 00:32:18 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e16f272-aee7-400d-b172-6c1881ff45ce]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:18 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7 Sep 23 00:32:18 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:19 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-2c118b0a-b773-4920-aaa0-b20a38cd3a63" returned: 0 in 0.293s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Lock "cinder-quobyte-2c118b0a-b773-4920-aaa0-b20a38cd3a63" released by "delete_volume" :: held 0.834s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:19 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61" returned: 0 in 0.378s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.560s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-534603919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7819dbca-3342-419d-9466-672b245db9c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b2dc3b9f7145a3ad3285542169a74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:16Z,use_quota=True,user_id='cc49c0a6d4e24be187ecdd3e940c22f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Creating volume 7819dbca-3342-419d-9466-672b245db9c5 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:19 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae10b4e1-9b32-49dc-932e-d35fcfeda338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:19 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 1073741824 Sep 23 00:32:19 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ec5bc9-4c25-45cb-88f4-76d2609e8f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:19 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Volume volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61 (c3a43d7d-be19-40be-8eeb-4aa6d6a39f61): created successfully Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ec5bc9-4c25-45cb-88f4-76d2609e8f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Flow 'volume_create_manager' (5ebd02d4-7c96-41e3-a729-52ca11e39777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:19 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e1ccd80e-b36f-4828-ba9f-33c66a041bd0 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created volume successfully. Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Created reservations ['da9b75e0-0840-44aa-9af7-cd45bfcf5240', '38951d8e-a2bc-40c3-9629-cf05e80c9990', '5989a31f-9f7f-47d5-8fb2-6618ec9d83f2', '5152b366-d0ba-421e-be91-e3d3bc487449'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:19 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7" returned: 0 in 0.548s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:19 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:19 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:19 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7 Sep 23 00:32:19 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:19 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.372s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:19 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Deleted volume successfully. Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c0091d20-6094-458b-a8dc-7146c0991cc8 tempest-VolumeAndVolumeTypeFromImageTest-853735299 None] Lock "cinder-2c118b0a-b773-4920-aaa0-b20a38cd3a63-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:19 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7" returned: 0 in 0.498s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-quobyte-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7" released by "delete_volume" :: held 1.120s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:19 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 1073741824" returned: 0 in 0.754s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:19 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Created reservations ['61c19ba1-23c0-421c-9a3f-fcc3ca889e4a', '2a8c6b55-e5e2-4bfa-a24f-8dbf37898daf', '4cf4c203-5428-4093-871c-5f951cf556af', '5d6f5f91-8c09-4880-ad49-de5622cfaf75'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:19 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 Sep 23 00:32:19 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:20 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:20 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-quobyte-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9d6e08-ec43-4a0a-9d51-36956f7fd88e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:20 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5" returned: 0 in 0.390s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff5c1a1-4b3e-4d26-a88e-897a29e90086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7819dbca-3342-419d-9466-672b245db9c5', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2aa707-28d4-4e2b-a81b-0e2829e4d19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:20 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Volume volume-7819dbca-3342-419d-9466-672b245db9c5 (7819dbca-3342-419d-9466-672b245db9c5): created successfully Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2aa707-28d4-4e2b-a81b-0e2829e4d19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Flow 'volume_create_manager' (c378bdd6-bf58-48cc-a99e-a2590dde63f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:20 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61 Sep 23 00:32:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-05fc3321-1364-4f76-ab3d-5f76aeebb97a tempest-ProjectReaderTests-1021144341 None] Created volume successfully. Sep 23 00:32:20 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:20 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.383s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:20 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Deleted volume successfully. Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-43f7c1d0-4ef9-4df6-8066-cb92b1a7fb8b tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-b6dfdb8c-fbc0-4c82-b0a1-29f874169ae7-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:20 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61" returned: 0 in 0.476s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:20 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61 Sep 23 00:32:20 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "cinder-01f4f047-ce61-44c5-8305-ecd2a36535c8-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] Creating offline snapshot 467e1bab-b255-4371-92ee-6a8769479598 of volume 7819dbca-3342-419d-9466-672b245db9c5 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-01f4f047-ce61-44c5-8305-ecd2a36535c8-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a93394c-4b4d-43b1-8897-ea28716d1c45]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "cinder-quobyte-01f4f047-ce61-44c5-8305-ecd2a36535c8" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-quobyte-01f4f047-ce61-44c5-8305-ecd2a36535c8" acquired by "delete_volume" :: waited 0.044s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:21 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61" returned: 0 in 0.564s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ff5009-0a75-440f-b46c-271bdc27cf53]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-01f4f047-ce61-44c5-8305-ecd2a36535c8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61" released by "delete_volume" :: held 1.136s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:21 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 Sep 23 00:32:21 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created reservations ['6afdc06e-6322-464a-86cd-80e7d1a39b6e', '11ebac60-f145-4d39-86b0-0a3775be8c5b', 'b01669ee-75a7-4935-85f0-aabe47d4b679', '6ccacb52-eecd-4612-8269-f66cbc978968'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:21 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-01f4f047-ce61-44c5-8305-ecd2a36535c8 Sep 23 00:32:21 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:21 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:21 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:21 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5" returned: 0 in 0.652s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:21 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 1G Sep 23 00:32:21 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:21 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.339s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:21 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Deleted volume successfully. Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-659ea4ff-8503-4631-8f62-9c6330e97568 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-c3a43d7d-be19-40be-8eeb-4aa6d6a39f61-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:21 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-01f4f047-ce61-44c5-8305-ecd2a36535c8" returned: 0 in 0.651s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-01f4f047-ce61-44c5-8305-ecd2a36535c8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:21 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-01f4f047-ce61-44c5-8305-ecd2a36535c8 Sep 23 00:32:21 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:22 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-01f4f047-ce61-44c5-8305-ecd2a36535c8" returned: 0 in 0.384s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-quobyte-01f4f047-ce61-44c5-8305-ecd2a36535c8" released by "delete_volume" :: held 1.126s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Created reservations ['d696b179-72ad-4f79-afdd-702e496d9078', 'bf8e6ea4-99cb-401d-9ff0-8e29efc852a8', 'f1351630-bed4-4e43-922c-9e3953114091', 'a7055c1c-6a6e-4d0a-9174-a450a6ad792b'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:22 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 1G" returned: 0 in 0.676s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7819dbca-3342-419d-9466-672b245db9c5 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:22 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7819dbca-3342-419d-9466-672b245db9c5 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 Sep 23 00:32:22 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-13ca14d9-e381-49b8-a06c-59f87989c345-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-13ca14d9-e381-49b8-a06c-59f87989c345-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-quobyte-13ca14d9-e381-49b8-a06c-59f87989c345" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:22 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:22 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-13ca14d9-e381-49b8-a06c-59f87989c345" acquired by "delete_volume" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16a804c-9b87-4bc0-aa51-ab9f8195ac78]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-13ca14d9-e381-49b8-a06c-59f87989c345 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:22 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-13ca14d9-e381-49b8-a06c-59f87989c345 Sep 23 00:32:22 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:22 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7819dbca-3342-419d-9466-672b245db9c5 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598" returned: 0 in 0.479s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:22 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 is being set with open permissions: ugo+rw Sep 23 00:32:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:22 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 Sep 23 00:32:22 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:23 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.488s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Deleted volume successfully. Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-79528032-013b-4bdb-b286-a2f8cf603cf5 tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-01f4f047-ce61-44c5-8305-ecd2a36535c8-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:23 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598" returned: 0 in 0.344s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:23 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-13ca14d9-e381-49b8-a06c-59f87989c345" returned: 0 in 0.581s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-13ca14d9-e381-49b8-a06c-59f87989c345 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:23 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-13ca14d9-e381-49b8-a06c-59f87989c345 Sep 23 00:32:23 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:23 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.info Sep 23 00:32:23 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "cinder-d03d0b52-32b1-47bc-a9e1-8108b62108b4-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-d03d0b52-32b1-47bc-a9e1-8108b62108b4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "cinder-quobyte-d03d0b52-32b1-47bc-a9e1-8108b62108b4" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-quobyte-d03d0b52-32b1-47bc-a9e1-8108b62108b4" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe67048e-577c-4380-8a97-ad598d1ef1f3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:23 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-13ca14d9-e381-49b8-a06c-59f87989c345" returned: 0 in 0.440s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:23 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-13ca14d9-e381-49b8-a06c-59f87989c345" released by "delete_volume" :: held 1.102s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.info" returned: 0 in 0.441s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:23 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.info is being set with open permissions: ugo+rw Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:23 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4 Sep 23 00:32:23 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:23 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.info Sep 23 00:32:23 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:23 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created reservations ['ae54b656-12bb-461c-8d9f-e4a7fa5cbf8b', 'dc71fa87-b1dd-49df-a02f-b4ad726fadef', '7e9809af-4e50-4faf-ab6b-5f1e4730c102', 'a54fa54b-eab1-4c27-b95e-acd6698dad43'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:24 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:24 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:24 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.info" returned: 0 in 0.401s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:24 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.166s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4" returned: 0 in 0.610s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:24 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4 Sep 23 00:32:24 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:24 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f2de8677-e122-4c12-bf08-d05a852bef05 tempest-ProjectReaderTests-1021144341 None] Create snapshot completed successfully Sep 23 00:32:24 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.330s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:24 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Deleted volume successfully. Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4f4a9a63-4b58-47fc-a568-d1a5bab0e333 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-13ca14d9-e381-49b8-a06c-59f87989c345-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:24 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-d03d0b52-32b1-47bc-a9e1-8108b62108b4" returned: 0 in 0.280s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-quobyte-d03d0b52-32b1-47bc-a9e1-8108b62108b4" released by "delete_volume" :: held 0.972s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Created reservations ['82015424-f9f7-42e3-bc16-9b899870b30b', '19f0dff1-67b9-4706-8e8c-db8be8d8fcb2', '07366f79-9be4-4008-aeb5-f2a64dd0c51c', 'd91a7cf9-cfcc-463d-a988-9501053da1bb'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:24 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:24 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-62392bbd-d8ac-4e06-820c-43b5324021a8-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-62392bbd-d8ac-4e06-820c-43b5324021a8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-quobyte-62392bbd-d8ac-4e06-820c-43b5324021a8" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:24 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.340s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-62392bbd-d8ac-4e06-820c-43b5324021a8" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:25 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Deleted volume successfully. Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fed9d3a-e89c-431a-9248-ada5a17a8137]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-62392bbd-d8ac-4e06-820c-43b5324021a8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-8409210e-8676-4ba5-98cd-3b87636da8fe tempest-CreateVolumesFromImageTest-99230566 None] Lock "cinder-d03d0b52-32b1-47bc-a9e1-8108b62108b4-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:25 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-62392bbd-d8ac-4e06-820c-43b5324021a8 Sep 23 00:32:25 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:25 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-62392bbd-d8ac-4e06-820c-43b5324021a8" returned: 0 in 0.421s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-62392bbd-d8ac-4e06-820c-43b5324021a8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:25 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-62392bbd-d8ac-4e06-820c-43b5324021a8 Sep 23 00:32:25 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-467e1bab-b255-4371-92ee-6a8769479598-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-467e1bab-b255-4371-92ee-6a8769479598-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-7819dbca-3342-419d-9466-672b245db9c5" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-7819dbca-3342-419d-9466-672b245db9c5" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-467e1bab-b255-4371-92ee-6a8769479598" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-467e1bab-b255-4371-92ee-6a8769479598" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Deleting offline snapshot 467e1bab-b255-4371-92ee-6a8769479598 of volume 7819dbca-3342-419d-9466-672b245db9c5 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] snapshot_file for this snap is: volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab998f7-c0eb-44e6-ae2e-02f71894bc04]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:25 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-62392bbd-d8ac-4e06-820c-43b5324021a8" returned: 0 in 0.365s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-62392bbd-d8ac-4e06-820c-43b5324021a8" released by "delete_volume" :: held 0.860s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:25 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 Sep 23 00:32:25 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:25 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created reservations ['d971a905-be00-4127-b8b7-64b2f53fefe3', 'dc5f6fda-4bc6-4756-a02f-1a57b03faf9d', '63fcd511-fba1-491f-a8e4-70b88668dedd', '9e4114a4-1db4-4b8f-8f02-cf66913dbe90'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Flow 'volume_create_manager' (824dace1-e4e8-426c-b9b9-b764ed233e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21bbbd0-0aa7-47b9-aeda-05992081d644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-7ddb6f27-fd97-43ae-bf76-4a9216eb4058-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c21bbbd0-0aa7-47b9-aeda-05992081d644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-604988143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375bb236-d79b-4966-9a29-5f3c9b04787a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97090a7088ae4b6ca7fb3ec502f71441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:26Z,use_quota=True,user_id='d9b4ab4729a0459897bdecae9fed4e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7785ad-a55a-43bb-92b3-e923ab0db8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:26 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:26 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7785ad-a55a-43bb-92b3-e923ab0db8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ff92ed-930c-4ecb-b852-da938d570043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ff92ed-930c-4ecb-b852-da938d570043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '375bb236-d79b-4966-9a29-5f3c9b04787a', 'volume_name': 'volume-375bb236-d79b-4966-9a29-5f3c9b04787a', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bef3d7-9309-475d-b95b-fa2ca1ba902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bef3d7-9309-475d-b95b-fa2ca1ba902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a04ec7-fc28-4108-94de-618f2ed31946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:26 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Volume 375bb236-d79b-4966-9a29-5f3c9b04787a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-375bb236-d79b-4966-9a29-5f3c9b04787a', 'volume_size': 1} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-604988143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375bb236-d79b-4966-9a29-5f3c9b04787a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97090a7088ae4b6ca7fb3ec502f71441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:26Z,use_quota=True,user_id='d9b4ab4729a0459897bdecae9fed4e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Creating volume 375bb236-d79b-4966-9a29-5f3c9b04787a {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:26 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-7ddb6f27-fd97-43ae-bf76-4a9216eb4058-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:26 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a 1073741824 Sep 23 00:32:26 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-quobyte-7ddb6f27-fd97-43ae-bf76-4a9216eb4058" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-7ddb6f27-fd97-43ae-bf76-4a9216eb4058" acquired by "delete_volume" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:26 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598" returned: 0 in 0.691s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7819dbca-3342-419d-9466-672b245db9c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[397d7299-72e9-4110-a00b-77f007c73a67]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dfb885-fa3c-46a8-aafe-e453763a0109]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:26 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058 Sep 23 00:32:26 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:26 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 Sep 23 00:32:26 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:26 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.425s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:26 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Deleted volume successfully. Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-112ffce5-0ca4-4d33-806c-54b00001bf7a tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-62392bbd-d8ac-4e06-820c-43b5324021a8-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:26 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058" returned: 0 in 0.507s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:26 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a 1073741824" returned: 0 in 0.700s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:27 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:27 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058 Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5" returned: 0 in 0.560s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:27 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:27 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 Sep 23 00:32:27 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:27 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a Sep 23 00:32:27 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:27 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7ddb6f27-fd97-43ae-bf76-4a9216eb4058" returned: 0 in 0.481s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-7ddb6f27-fd97-43ae-bf76-4a9216eb4058" released by "delete_volume" :: held 1.063s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:27 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created reservations ['aff58b76-9d86-4835-9ce5-9f43b56116e0', '87b066c6-7122-4859-8178-dd4cd2ff8e57', 'be5a46ae-ac07-4864-8a70-05cb15bfb4b9', 'f8b0cc1d-67d4-4915-a32a-7fa99a126289'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598" returned: 0 in 0.507s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:27 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a" returned: 0 in 0.480s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:27 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598 Sep 23 00:32:27 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a04ec7-fc28-4108-94de-618f2ed31946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-375bb236-d79b-4966-9a29-5f3c9b04787a', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08616119-ef58-4809-ad24-e6d7fde47e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:27 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Volume volume-375bb236-d79b-4966-9a29-5f3c9b04787a (375bb236-d79b-4966-9a29-5f3c9b04787a): created successfully Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08616119-ef58-4809-ad24-e6d7fde47e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Flow 'volume_create_manager' (824dace1-e4e8-426c-b9b9-b764ed233e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:27 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-167968fc-b41e-42cd-bac6-758d9796b734 tempest-VolumeDependencyTests-1730479762 None] Created volume successfully. Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:27 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:27 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:27 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5.467e1bab-b255-4371-92ee-6a8769479598" returned: 0 in 0.397s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-467e1bab-b255-4371-92ee-6a8769479598" released by "_delete_snapshot" :: held 2.330s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-7819dbca-3342-419d-9466-672b245db9c5" released by "delete_snapshot" :: held 2.374s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:28 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.376s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:28 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Deleted volume successfully. Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Created reservations ['81dfb0e2-7ef5-45b9-8241-aabfec540a7f', '5f0a1ab9-6093-487c-868a-8a20d0e28011', '4c262897-0a5e-4ca4-8826-c4d865bc964d', '13d01678-a241-431e-853b-6f97f93f3aaf'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1aa21263-0466-4ebf-9cc3-db1e4ec9dc5e tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-7ddb6f27-fd97-43ae-bf76-4a9216eb4058-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:28 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Delete snapshot completed successfully. Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-febe3d4b-dbab-4413-a7c1-1cfcc909c981 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-467e1bab-b255-4371-92ee-6a8769479598-delete_snapshot" released by "delete_snapshot" :: held 2.605s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] Creating offline snapshot 734dbedc-d4b3-4e31-8f89-fd5352a05639 of volume 375bb236-d79b-4966-9a29-5f3c9b04787a {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d67a2c7-42b0-4ff4-aa5f-c5a484c14425]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-0375a450-e51c-499d-905f-f7ac3c3453b3-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-0375a450-e51c-499d-905f-f7ac3c3453b3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-quobyte-0375a450-e51c-499d-905f-f7ac3c3453b3" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-0375a450-e51c-499d-905f-f7ac3c3453b3" acquired by "delete_volume" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:28 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a Sep 23 00:32:28 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6b7d95-a8d7-438b-90be-95ac2aec7f8f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0375a450-e51c-499d-905f-f7ac3c3453b3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-7819dbca-3342-419d-9466-672b245db9c5-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-7819dbca-3342-419d-9466-672b245db9c5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:28 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0375a450-e51c-499d-905f-f7ac3c3453b3 Sep 23 00:32:28 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-7819dbca-3342-419d-9466-672b245db9c5" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-7819dbca-3342-419d-9466-672b245db9c5" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9df7dd-77d1-4f18-ab08-8d075c36df04]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:29 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a" returned: 0 in 0.663s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:29 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 1G Sep 23 00:32:29 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:29 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 Sep 23 00:32:29 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:29 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0375a450-e51c-499d-905f-f7ac3c3453b3" returned: 0 in 0.606s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0375a450-e51c-499d-905f-f7ac3c3453b3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:29 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0375a450-e51c-499d-905f-f7ac3c3453b3 Sep 23 00:32:29 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:29 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5" returned: 0 in 0.576s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:29 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-0375a450-e51c-499d-905f-f7ac3c3453b3" returned: 0 in 0.331s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:29 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5 Sep 23 00:32:29 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-0375a450-e51c-499d-905f-f7ac3c3453b3" released by "delete_volume" :: held 1.011s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created reservations ['996fa45c-87d0-46a8-9410-92ac56e55474', '0bb275d0-e0e0-412f-b2fa-2ebf3d7fba59', '4ff6dc13-09b7-45e9-9464-a2687aa999b3', 'd92ea52d-1b0c-4f4d-bf9f-e9d62a8f1de2'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:29 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 1G" returned: 0 in 0.656s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-375bb236-d79b-4966-9a29-5f3c9b04787a -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:29 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-375bb236-d79b-4966-9a29-5f3c9b04787a -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 Sep 23 00:32:29 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:29 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:29 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:30 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-7819dbca-3342-419d-9466-672b245db9c5" returned: 0 in 0.403s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-7819dbca-3342-419d-9466-672b245db9c5" released by "delete_volume" :: held 1.095s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Created reservations ['9f0a6c02-3292-47b8-a223-cf19980c0e3e', '632a410e-e6a5-4759-a586-2e863a034eae', '036e88c5-67b5-4c61-ba2d-f251a88fa543', '758b322a-48cc-4649-8605-a469f6468fcc'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:30 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-375bb236-d79b-4966-9a29-5f3c9b04787a -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639" returned: 0 in 0.400s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:30 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 is being set with open permissions: ugo+rw Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:30 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 Sep 23 00:32:30 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:30 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.372s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:30 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Deleted volume successfully. Sep 23 00:32:30 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:30 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-dd75e508-d31a-4608-bf05-0fc0b743361d tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-0375a450-e51c-499d-905f-f7ac3c3453b3-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:30 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639" returned: 0 in 0.336s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:30 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.info Sep 23 00:32:30 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:30 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.337s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:30 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Deleted volume successfully. Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Flow 'volume_create_manager' (86502707-7303-41a0-82a7-42c52797b8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c13296-3d90-48ca-be9d-85e3ad2fa198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1f1a5faa-ac0e-49f9-8e9a-31e09f0a2c42 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-7819dbca-3342-419d-9466-672b245db9c5-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c13296-3d90-48ca-be9d-85e3ad2fa198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-830235790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac376f77-82c5-4f2a-b750-01628b71aebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fb275efda94a8bba366eef775f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:31Z,use_quota=True,user_id='02c84ee0786b47bba3bd35f00983de4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f68c4dd-2100-4d8c-9219-4f6ed008654d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f68c4dd-2100-4d8c-9219-4f6ed008654d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8f3977-9e3a-45eb-a7ea-dfb85aa10079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8f3977-9e3a-45eb-a7ea-dfb85aa10079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac376f77-82c5-4f2a-b750-01628b71aebc', 'volume_name': 'volume-ac376f77-82c5-4f2a-b750-01628b71aebc', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e74df24-16f5-4d89-8685-1d532af9d89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e74df24-16f5-4d89-8685-1d532af9d89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33528f06-2a21-47a6-b29a-9fa8ca1f15d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:30 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume ac376f77-82c5-4f2a-b750-01628b71aebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac376f77-82c5-4f2a-b750-01628b71aebc', 'volume_size': 1} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-1fd6632f-0349-40c2-8a44-309b134dc7bf-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-1fd6632f-0349-40c2-8a44-309b134dc7bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-quobyte-4964cca3-f9fa-423c-8e82-0081a202f235" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:30 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-4964cca3-f9fa-423c-8e82-0081a202f235" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-quobyte-1fd6632f-0349-40c2-8a44-309b134dc7bf" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.info" returned: 0 in 0.347s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:30 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.info is being set with open permissions: ugo+rw Sep 23 00:32:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-1fd6632f-0349-40c2-8a44-309b134dc7bf" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Deleting offline snapshot 1fd6632f-0349-40c2-8a44-309b134dc7bf of volume 4964cca3-f9fa-423c-8e82-0081a202f235 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:32:31 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.info Sep 23 00:32:31 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] snapshot_file for this snap is: volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5201acfb-d7b2-4ac0-8a83-c36a0b066dc0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:31 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf Sep 23 00:32:31 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:31 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.info" returned: 0 in 0.343s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.552s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-830235790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac376f77-82c5-4f2a-b750-01628b71aebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fb275efda94a8bba366eef775f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:31Z,use_quota=True,user_id='02c84ee0786b47bba3bd35f00983de4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Creating volume ac376f77-82c5-4f2a-b750-01628b71aebc {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:31 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac376f77-82c5-4f2a-b750-01628b71aebc 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:31 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac376f77-82c5-4f2a-b750-01628b71aebc 1073741824 Sep 23 00:32:31 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:31 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c94a5080-8a56-49a2-931b-6b276873e81a tempest-VolumeDependencyTests-1730479762 None] Create snapshot completed successfully Sep 23 00:32:31 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf" returned: 0 in 0.480s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4964cca3-f9fa-423c-8e82-0081a202f235(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da6ad39-8992-4f09-b1aa-43ae6db90c4c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:31 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 Sep 23 00:32:31 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Flow 'volume_create_manager' (2f62a095-4299-438c-b02c-74f13c76921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785e406e-0883-4510-9023-0c8f8b1fe0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785e406e-0883-4510-9023-0c8f8b1fe0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1865007779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f25259-65d4-4e26-af78-84a1aa3cc489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b2dc3b9f7145a3ad3285542169a74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:32Z,use_quota=True,user_id='cc49c0a6d4e24be187ecdd3e940c22f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252997f6-26ba-42c7-92c5-ecc9baf57513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252997f6-26ba-42c7-92c5-ecc9baf57513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04aa4d06-399c-4ac7-b627-6a08cc14726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04aa4d06-399c-4ac7-b627-6a08cc14726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f25259-65d4-4e26-af78-84a1aa3cc489', 'volume_name': 'volume-31f25259-65d4-4e26-af78-84a1aa3cc489', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498b34bd-a6da-452c-a43d-9a06cebea6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498b34bd-a6da-452c-a43d-9a06cebea6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a919b731-9d64-4f60-999a-9ed6a25bf737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Volume 31f25259-65d4-4e26-af78-84a1aa3cc489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f25259-65d4-4e26-af78-84a1aa3cc489', 'volume_size': 1} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:32 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac376f77-82c5-4f2a-b750-01628b71aebc 1073741824" returned: 0 in 0.796s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac376f77-82c5-4f2a-b750-01628b71aebc {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:32 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235" returned: 0 in 0.640s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:32 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac376f77-82c5-4f2a-b750-01628b71aebc Sep 23 00:32:32 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:32 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf Sep 23 00:32:32 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:32 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac376f77-82c5-4f2a-b750-01628b71aebc" returned: 0 in 0.357s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Flow 'volume_create_manager' (73fcf3a3-efef-47b4-8f24-12bc7eb75ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a26b95-eee6-4716-94f8-53e622e4dc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1865007779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f25259-65d4-4e26-af78-84a1aa3cc489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b2dc3b9f7145a3ad3285542169a74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:32Z,use_quota=True,user_id='cc49c0a6d4e24be187ecdd3e940c22f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Creating volume 31f25259-65d4-4e26-af78-84a1aa3cc489 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:32 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:32 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 1073741824 Sep 23 00:32:32 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a26b95-eee6-4716-94f8-53e622e4dc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-254222728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f495a2-1179-47ac-9225-9b7eab7797f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97090a7088ae4b6ca7fb3ec502f71441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=734dbedc-d4b3-4e31-8f89-fd5352a05639,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:33Z,use_quota=True,user_id='d9b4ab4729a0459897bdecae9fed4e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5093ef17-e723-4a79-a417-dcc4bdc46c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5093ef17-e723-4a79-a417-dcc4bdc46c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7d015a-7a7b-4b5c-938b-1c66e1aeb63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7d015a-7a7b-4b5c-938b-1c66e1aeb63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4f495a2-1179-47ac-9225-9b7eab7797f4', 'volume_name': 'volume-c4f495a2-1179-47ac-9225-9b7eab7797f4', 'volume_size': 1, 'snapshot_id': '734dbedc-d4b3-4e31-8f89-fd5352a05639'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262c2d7d-add1-48e6-8d5d-ce962c352e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262c2d7d-add1-48e6-8d5d-ce962c352e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d143a0f-b9ee-4c40-ab27-bfc0ec618b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Volume c4f495a2-1179-47ac-9225-9b7eab7797f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4f495a2-1179-47ac-9225-9b7eab7797f4', 'volume_size': 1, 'snapshot_id': '734dbedc-d4b3-4e31-8f89-fd5352a05639'} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33528f06-2a21-47a6-b29a-9fa8ca1f15d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac376f77-82c5-4f2a-b750-01628b71aebc', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3e1394-0365-4ad3-bdd1-d50889ff64ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:32 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume volume-ac376f77-82c5-4f2a-b750-01628b71aebc (ac376f77-82c5-4f2a-b750-01628b71aebc): created successfully Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3e1394-0365-4ad3-bdd1-d50889ff64ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Flow 'volume_create_manager' (86502707-7303-41a0-82a7-42c52797b8f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:32 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ad28b60a-5bb4-42a7-a3ce-c892b2c6816b tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Created volume successfully. Sep 23 00:32:32 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf" returned: 0 in 0.585s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:32 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf Sep 23 00:32:32 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:33 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235.1fd6632f-0349-40c2-8a44-309b134dc7bf" returned: 0 in 0.301s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-1fd6632f-0349-40c2-8a44-309b134dc7bf" released by "_delete_snapshot" :: held 2.177s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-4964cca3-f9fa-423c-8e82-0081a202f235" released by "delete_snapshot" :: held 2.214s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:33 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 1073741824" returned: 0 in 0.611s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created reservations ['a067e66c-e722-4f89-9167-8ae38d332ed4', '0f2b5c4d-35e9-472b-b8bb-2669e8dbf0c6', '7ff554c7-9e2c-4454-802d-40223cdcf506', '9eadd971-3e51-44f4-89a8-c8c7919f7b3e'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:33 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 Sep 23 00:32:33 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:33 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Delete snapshot completed successfully. Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c587706a-4db7-4645-a8e9-576d7f1c6eb9 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-1fd6632f-0349-40c2-8a44-309b134dc7bf-delete_snapshot" released by "delete_snapshot" :: held 2.410s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:33 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489" returned: 0 in 0.269s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.827s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "cinder-quobyte-734dbedc-d4b3-4e31-8f89-fd5352a05639-c4f495a2-1179-47ac-9225-9b7eab7797f4" by "_create_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a919b731-9d64-4f60-999a-9ed6a25bf737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f25259-65d4-4e26-af78-84a1aa3cc489', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb3ab50-ebf5-4e7b-b1b3-4e7a0f5e1c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-quobyte-734dbedc-d4b3-4e31-8f89-fd5352a05639-c4f495a2-1179-47ac-9225-9b7eab7797f4" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Creating volume c4f495a2-1179-47ac-9225-9b7eab7797f4 from snapshot 734dbedc-d4b3-4e31-8f89-fd5352a05639 {{(pid=86481) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "cinder-quobyte-c4f495a2-1179-47ac-9225-9b7eab7797f4" by "_copy_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:33 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Volume volume-31f25259-65d4-4e26-af78-84a1aa3cc489 (31f25259-65d4-4e26-af78-84a1aa3cc489): created successfully Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb3ab50-ebf5-4e7b-b1b3-4e7a0f5e1c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Flow 'volume_create_manager' (2f62a095-4299-438c-b02c-74f13c76921f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-quobyte-c4f495a2-1179-47ac-9225-9b7eab7797f4" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] snapshot: 734dbedc-d4b3-4e31-8f89-fd5352a05639, volume: c4f495a2-1179-47ac-9225-9b7eab7797f4, {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:32:33 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-fae7aad1-f826-4320-8bbb-29407dd26466 tempest-ProjectReaderTests-1021144341 None] Created volume successfully. Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f046504d-84a8-40c4-9204-ae79cac048b6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:33 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 Sep 23 00:32:33 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:34 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639" returned: 0 in 0.544s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-375bb236-d79b-4966-9a29-5f3c9b04787a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3e1dc2-95ed-42cf-a03f-d87343a233b5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-4964cca3-f9fa-423c-8e82-0081a202f235-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-4964cca3-f9fa-423c-8e82-0081a202f235-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "cinder-quobyte-4964cca3-f9fa-423c-8e82-0081a202f235" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-4964cca3-f9fa-423c-8e82-0081a202f235" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:34 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a Sep 23 00:32:34 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[865cc09a-1e8d-4c21-8fcd-3dfdb189a3ae]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Flow 'volume_create_manager' (78621fda-3d61-4860-9ec0-e09153b1e706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f93097-c15e-4e78-8c7d-df6a5a6140bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:34 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 Sep 23 00:32:34 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f93097-c15e-4e78-8c7d-df6a5a6140bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141636449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fb275efda94a8bba366eef775f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:35Z,use_quota=True,user_id='02c84ee0786b47bba3bd35f00983de4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68480655-28ab-4625-915c-2e36799b402f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68480655-28ab-4625-915c-2e36799b402f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce38d8b-ec84-425c-83f9-0d4e4a3a43e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce38d8b-ec84-425c-83f9-0d4e4a3a43e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15', 'volume_name': 'volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a50913f-b288-4721-bd3b-8f6dffa45b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a50913f-b288-4721-bd3b-8f6dffa45b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580e0e8b-15b0-494b-bf77-7774b22cf196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:34 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15', 'volume_size': 1} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:34 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a" returned: 0 in 0.530s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Creating direct copy from snapshot {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG cinder.utils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Path /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4 not found in is_blk_device check {{(pid=86481) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:32:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:34 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4 Sep 23 00:32:34 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Flow 'volume_create_manager' (fe9dcf73-4abe-4441-a889-72b9b1622331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2e47a9-af61-42e6-a620-44b9e7fb658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2e47a9-af61-42e6-a620-44b9e7fb658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1435135075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fb275efda94a8bba366eef775f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:35Z,use_quota=True,user_id='02c84ee0786b47bba3bd35f00983de4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4e9741-9f64-4e48-b97a-2dc642667d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4e9741-9f64-4e48-b97a-2dc642667d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e900e621-ed07-4820-bbfb-8f1348bf19b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e900e621-ed07-4820-bbfb-8f1348bf19b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83', 'volume_name': 'volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d93449d-d512-46ab-b71f-523d82dd0c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d93449d-d512-46ab-b71f-523d82dd0c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241d096a-92ca-4a43-b0fc-8ee6a5e27fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83', 'volume_size': 1} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235" returned: 0 in 0.719s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:35 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235 Sep 23 00:32:35 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:35 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-4964cca3-f9fa-423c-8e82-0081a202f235" returned: 0 in 0.315s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-quobyte-4964cca3-f9fa-423c-8e82-0081a202f235" released by "delete_volume" :: held 1.163s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Flow 'volume_create_manager' (ecd166aa-b6e3-4153-9f21-1a046f759a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a592a0-94ec-47fa-8d3d-ea81ef484742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a592a0-94ec-47fa-8d3d-ea81ef484742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-63164744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89651d26-161a-40d0-8ba1-4f75c2d633da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fb275efda94a8bba366eef775f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:35Z,use_quota=True,user_id='02c84ee0786b47bba3bd35f00983de4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33d1a54-f663-402e-a532-b25dddb9b517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33d1a54-f663-402e-a532-b25dddb9b517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693b63ce-26f3-4f15-87dc-595e075a2742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693b63ce-26f3-4f15-87dc-595e075a2742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89651d26-161a-40d0-8ba1-4f75c2d633da', 'volume_name': 'volume-89651d26-161a-40d0-8ba1-4f75c2d633da', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1f8bf6-0fba-4c1d-b4fa-0375a95dfc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1f8bf6-0fba-4c1d-b4fa-0375a95dfc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ee5322-68a9-49a0-b2f4-62bc28ceca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:35 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume 89651d26-161a-40d0-8ba1-4f75c2d633da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89651d26-161a-40d0-8ba1-4f75c2d633da', 'volume_size': 1} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:35 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Created reservations ['dcec945a-8595-4a3d-a12a-7a856147ef2e', '538228c4-7933-40c9-8507-a96cdf85b91d', '73d73944-dbf5-4a71-921b-128b3e1e9f76', '69ccd168-e337-4deb-a81c-f5b61db9b931'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:36 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:36 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:36 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.470s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:36 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Deleted volume successfully. Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-701b3c3a-393a-40b0-9768-ceef72bc6e46 tempest-CreateVolumesFromSnapshotTest-1024443667 None] Lock "cinder-4964cca3-f9fa-423c-8e82-0081a202f235-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Flow 'volume_create_manager' (1261bc0b-756b-4569-8f7b-259985e4054f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46e9be6-cb6b-4e76-bc2c-e727eb583437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46e9be6-cb6b-4e76-bc2c-e727eb583437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894627084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17b1a9d-b85f-49dc-b928-a2b89124f51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fb275efda94a8bba366eef775f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:37Z,use_quota=True,user_id='02c84ee0786b47bba3bd35f00983de4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf0da00-0060-40a9-a72e-a9c130c9c869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf0da00-0060-40a9-a72e-a9c130c9c869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f667860-23a4-4fdf-bb3d-a91748d1c3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f667860-23a4-4fdf-bb3d-a91748d1c3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a17b1a9d-b85f-49dc-b928-a2b89124f51a', 'volume_name': 'volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1287d9-ca89-4347-9937-014afbbac0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1287d9-ca89-4347-9937-014afbbac0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38cbb9c-babf-45e7-ab17-22f2b4b4ae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:37 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume a17b1a9d-b85f-49dc-b928-a2b89124f51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a', 'volume_size': 1} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Flow 'volume_create_manager' (3a445560-7222-4ae4-9bcc-fb481eba1f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c85e20-c9c0-4444-9b87-f0fe0aa53d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c85e20-c9c0-4444-9b87-f0fe0aa53d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-118124283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796888e5-e32e-4675-b9b2-f15730789aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fb275efda94a8bba366eef775f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:38Z,use_quota=True,user_id='02c84ee0786b47bba3bd35f00983de4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004ae5ba-96a3-47c8-857f-7064a8ebb4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004ae5ba-96a3-47c8-857f-7064a8ebb4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498ff62b-298e-4bb9-ab2c-a9d27ed2fb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498ff62b-298e-4bb9-ab2c-a9d27ed2fb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '796888e5-e32e-4675-b9b2-f15730789aa1', 'volume_name': 'volume-796888e5-e32e-4675-b9b2-f15730789aa1', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1998742d-b991-4855-aa7c-6c91bbc748a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1998742d-b991-4855-aa7c-6c91bbc748a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f78827-9980-430a-bffd-5b9f183f2ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:37 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume 796888e5-e32e-4675-b9b2-f15730789aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-796888e5-e32e-4675-b9b2-f15730789aa1', 'volume_size': 1} Sep 23 00:32:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:43 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4" returned: 0 in 8.582s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a, size 1024.00 MB, duration 8.58 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:32:43 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Converted 1024.00 MB image at 119.30 MB/s Sep 23 00:32:43 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4 is being set with open permissions: ugo+rw Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:43 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4 Sep 23 00:32:43 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:43 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4" returned: 0 in 0.296s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-quobyte-c4f495a2-1179-47ac-9225-9b7eab7797f4" released by "_copy_volume_from_snapshot" :: held 10.064s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-quobyte-734dbedc-d4b3-4e31-8f89-fd5352a05639-c4f495a2-1179-47ac-9225-9b7eab7797f4" released by "_create_volume_from_snapshot" :: held 10.159s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.194s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.566s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] Creating offline snapshot 6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 of volume 31f25259-65d4-4e26-af78-84a1aa3cc489 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d143a0f-b9ee-4c40-ab27-bfc0ec618b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f495a2-1179-47ac-9225-9b7eab7797f4', 'volume_size': 1, 'snapshot_id': '734dbedc-d4b3-4e31-8f89-fd5352a05639'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf518bd-d8ea-4e5f-8a4e-0fd7a187b081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef21c22-d0b7-4ff0-b1d1-aa9ebc2135a0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:43 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Volume volume-c4f495a2-1179-47ac-9225-9b7eab7797f4 (c4f495a2-1179-47ac-9225-9b7eab7797f4): created successfully Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf518bd-d8ea-4e5f-8a4e-0fd7a187b081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:43 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Flow 'volume_create_manager' (73fcf3a3-efef-47b4-8f24-12bc7eb75ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:43 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-de8d58e7-fd09-44fb-95a3-652149a1b813 tempest-VolumeDependencyTests-1730479762 None] Created volume successfully. Sep 23 00:32:43 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 Sep 23 00:32:43 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:44 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489" returned: 0 in 0.480s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:44 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 1G Sep 23 00:32:44 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "cinder-734dbedc-d4b3-4e31-8f89-fd5352a05639-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-734dbedc-d4b3-4e31-8f89-fd5352a05639-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "cinder-quobyte-375bb236-d79b-4966-9a29-5f3c9b04787a" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-quobyte-375bb236-d79b-4966-9a29-5f3c9b04787a" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "cinder-quobyte-734dbedc-d4b3-4e31-8f89-fd5352a05639" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-quobyte-734dbedc-d4b3-4e31-8f89-fd5352a05639" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Deleting offline snapshot 734dbedc-d4b3-4e31-8f89-fd5352a05639 of volume 375bb236-d79b-4966-9a29-5f3c9b04787a {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:32:44 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] snapshot_file for this snap is: volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 1G" returned: 0 in 0.598s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f25259-65d4-4e26-af78-84a1aa3cc489 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1bbb24-fb13-4c82-8a1f-dd66927333eb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:44 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f25259-65d4-4e26-af78-84a1aa3cc489 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 Sep 23 00:32:44 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:45 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:45 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:45 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 Sep 23 00:32:45 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:45 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.351s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:32:45 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f25259-65d4-4e26-af78-84a1aa3cc489 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184" returned: 0 in 0.492s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:45 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 is being set with open permissions: ugo+rw Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:45 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:45 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 Sep 23 00:32:45 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639" returned: 0 in 0.507s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-375bb236-d79b-4966-9a29-5f3c9b04787a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[4684bb17-44fd-42ec-b916-fe2df7962dbb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:45 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a Sep 23 00:32:45 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:45 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184" returned: 0 in 0.374s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:45 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.info Sep 23 00:32:45 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:46 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.info" returned: 0 in 0.352s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:46 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.info is being set with open permissions: ugo+rw Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:46 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a" returned: 0 in 0.712s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:46 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.info Sep 23 00:32:46 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:46 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 Sep 23 00:32:46 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:46 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.info" returned: 0 in 0.311s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.738s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.751s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141636449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fb275efda94a8bba366eef775f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:35Z,use_quota=True,user_id='02c84ee0786b47bba3bd35f00983de4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Creating volume cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:46 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:46 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15 1073741824 Sep 23 00:32:46 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:46 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3dcbc7fa-3b93-4c4e-8c8c-5ca00f0b1caf tempest-ProjectReaderTests-1021144341 None] Create snapshot completed successfully Sep 23 00:32:46 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639" returned: 0 in 0.504s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:46 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639 Sep 23 00:32:46 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Flow 'volume_create_manager' (623fbbd9-f92e-404c-b78b-3453f7348546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbad97b1-f4d0-4d69-a03f-c871ebd59ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbad97b1-f4d0-4d69-a03f-c871ebd59ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10f8748-3fa8-415c-aa04-7d8b6506d1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48a4d6311a1d4be79ca01dc85d43eafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:47Z,use_quota=True,user_id='ba4d7f4221c64be289a9990b71fb8261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de788732-0de0-40c9-9925-c308043cfc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de788732-0de0-40c9-9925-c308043cfc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:46 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75257a2f-afd1-4fca-b35d-0c2d2e73c919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.image.glance [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Creating Keystone auth plugin from conf {{(pid=86481) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-31f25259-65d4-4e26-af78-84a1aa3cc489" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-31f25259-65d4-4e26-af78-84a1aa3cc489" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:47 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Deleting offline snapshot 6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 of volume 31f25259-65d4-4e26-af78-84a1aa3cc489 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:32:47 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] snapshot_file for this snap is: volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15 1073741824" returned: 0 in 0.683s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a.734dbedc-d4b3-4e31-8f89-fd5352a05639" returned: 0 in 0.517s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12fd63b-71ec-4dd1-87b6-9bbde118e210]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-quobyte-734dbedc-d4b3-4e31-8f89-fd5352a05639" released by "_delete_snapshot" :: held 2.453s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-quobyte-375bb236-d79b-4966-9a29-5f3c9b04787a" released by "delete_snapshot" :: held 2.492s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 Sep 23 00:32:47 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15 Sep 23 00:32:47 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75257a2f-afd1-4fca-b35d-0c2d2e73c919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f10f8748-3fa8-415c-aa04-7d8b6506d1c7', 'volume_name': 'volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7', 'volume_size': 1, 'image_id': 'b4b50218-c594-4744-b176-250be7f2eac1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4b50218-c594-4744-b176-250be7f2eac1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '10c79596ec4503f82395c17d118a8e7f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '48a4d6311a1d4be79ca01dc85d43eafd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '938d993262ccba0157fa5b623b34ee1e144dfbfe6e1d8e0ad8c8bae8f26fb207fd8319b133fca687ef0a36642d47fcd7620873b658c20fc327ff3c2b5b1a8cbb', 'id': 'b4b50218-c594-4744-b176-250be7f2eac1', 'created_at': datetime.datetime(2026, 9, 22, 22, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4b50218-c594-4744-b176-250be7f2eac1/file', 'properties': {}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64353ac-46cb-42d4-9eb5-e98b84fdbac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64353ac-46cb-42d4-9eb5-e98b84fdbac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70c3792-9270-4269-88b8-202fc9cc9bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:47 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Volume f10f8748-3fa8-415c-aa04-7d8b6506d1c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7', 'volume_size': 1, 'image_id': 'b4b50218-c594-4744-b176-250be7f2eac1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4b50218-c594-4744-b176-250be7f2eac1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '10c79596ec4503f82395c17d118a8e7f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '48a4d6311a1d4be79ca01dc85d43eafd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '938d993262ccba0157fa5b623b34ee1e144dfbfe6e1d8e0ad8c8bae8f26fb207fd8319b133fca687ef0a36642d47fcd7620873b658c20fc327ff3c2b5b1a8cbb', 'id': 'b4b50218-c594-4744-b176-250be7f2eac1', 'created_at': datetime.datetime(2026, 9, 22, 22, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4b50218-c594-4744-b176-250be7f2eac1/file', 'properties': {}}, 'image_service': } Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Trying to clone f10f8748-3fa8-415c-aa04-7d8b6506d1c7 from image b4b50218-c594-4744-b176-250be7f2eac1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4b50218-c594-4744-b176-250be7f2eac1', 'metadata': {}}]). {{(pid=86481) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Created reservations ['2e533a32-7902-40d0-829e-9f1a20a39b08', '1bc4e82e-5439-4826-8d01-3a350aaee533', '17dd2558-abb9-44bf-af0e-c7c93db5e4c9', '20e34ff8-d823-4923-8cd7-b05c7989aea4'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:47 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Delete snapshot completed successfully. Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6f714834-f3e4-46df-880c-296f9fd18b4e tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-734dbedc-d4b3-4e31-8f89-fd5352a05639-delete_snapshot" released by "delete_snapshot" :: held 2.837s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:32:47 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e13b75a-86ed-4bbf-b954-7c55536c8b06]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:47 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184" returned: 0 in 0.536s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31f25259-65d4-4e26-af78-84a1aa3cc489(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15" returned: 0 in 0.447s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.603s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1435135075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fb275efda94a8bba366eef775f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:35Z,use_quota=True,user_id='02c84ee0786b47bba3bd35f00983de4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Creating volume e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:47 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e699b81-183e-4915-9721-dfb66040e2b9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:47 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83 1073741824 Sep 23 00:32:47 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580e0e8b-15b0-494b-bf77-7774b22cf196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69f03be-af22-4f61-a263-e67fe94a94de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:47 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15 (cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15): created successfully Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69f03be-af22-4f61-a263-e67fe94a94de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:47 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD Sep 23 00:32:47 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:47 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Flow 'volume_create_manager' (78621fda-3d61-4860-9ec0-e09153b1e706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:47 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6792c43b-ccdc-4b96-81af-85f22bce119f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Created volume successfully. Sep 23 00:32:48 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 Sep 23 00:32:48 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "cinder-375bb236-d79b-4966-9a29-5f3c9b04787a-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-375bb236-d79b-4966-9a29-5f3c9b04787a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:48 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "cinder-quobyte-375bb236-d79b-4966-9a29-5f3c9b04787a" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-quobyte-375bb236-d79b-4966-9a29-5f3c9b04787a" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[da57fc07-6cbc-4bd9-88be-d02d8270f828]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:48 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD Sep 23 00:32:48 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:48 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a Sep 23 00:32:48 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:48 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83 1073741824" returned: 0 in 0.618s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:48 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489" returned: 0 in 0.682s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:48 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 Sep 23 00:32:48 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:48 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83 Sep 23 00:32:48 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:48 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD" returned: 1 in 0.431s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Temporary image b4b50218-c594-4744-b176-250be7f2eac1 is fetched for user ba4d7f4221c64be289a9990b71fb8261. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb33249-8d0b-4796-83d0-865780ff7347]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:48 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a" returned: 0 in 0.608s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:48 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a Sep 23 00:32:48 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:48 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD Sep 23 00:32:48 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83" returned: 0 in 0.507s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.252s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-63164744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89651d26-161a-40d0-8ba1-4f75c2d633da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fb275efda94a8bba366eef775f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:35Z,use_quota=True,user_id='02c84ee0786b47bba3bd35f00983de4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Creating volume 89651d26-161a-40d0-8ba1-4f75c2d633da {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:49 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-89651d26-161a-40d0-8ba1-4f75c2d633da 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241d096a-92ca-4a43-b0fc-8ee6a5e27fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369be213-305b-458e-87d3-11cee75fb3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:49 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-89651d26-161a-40d0-8ba1-4f75c2d633da 1073741824 Sep 23 00:32:49 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184" returned: 0 in 0.630s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83 (e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83): created successfully Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369be213-305b-458e-87d3-11cee75fb3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:49 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184 Sep 23 00:32:49 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Flow 'volume_create_manager' (fe9dcf73-4abe-4441-a889-72b9b1622331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:49 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-886dbb64-3a77-49df-a14a-8acf5dad1e66 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Created volume successfully. Sep 23 00:32:49 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-375bb236-d79b-4966-9a29-5f3c9b04787a" returned: 0 in 0.497s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-quobyte-375bb236-d79b-4966-9a29-5f3c9b04787a" released by "delete_volume" :: held 1.191s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD" returned: 0 in 0.651s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Created reservations ['42eaec09-51df-4054-a928-837d7a604532', 'd097eb6c-19b1-48c1-9284-ec0b16cdc2e1', '1ff9a517-a6c2-4a1f-bb57-01e3913ef268', '665ae7fa-0d94-497b-bea4-53dd0a9b3940'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:49 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489.6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184" returned: 0 in 0.462s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD Sep 23 00:32:49 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184" released by "_delete_snapshot" :: held 2.479s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-31f25259-65d4-4e26-af78-84a1aa3cc489" released by "delete_snapshot" :: held 2.514s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:49 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-89651d26-161a-40d0-8ba1-4f75c2d633da 1073741824" returned: 0 in 0.655s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:49 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-89651d26-161a-40d0-8ba1-4f75c2d633da {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Created reservations ['351e99d2-277c-4a1c-ae2c-95e709eadf0d', '9da3d31d-b2af-4c1f-9f14-5cdd0e2e22a7', 'dc5b0dbc-bcc9-4d12-96d8-b6b7379296e2', '3b2505dc-95d3-4195-9816-17191f6ea199'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:49 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-89651d26-161a-40d0-8ba1-4f75c2d633da Sep 23 00:32:49 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:49 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD" returned: 1 in 0.533s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:32:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:49 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Delete snapshot completed successfully. Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e65e5867-921a-4048-81cb-b882bfb4a684 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-6f1a70f3-c6aa-49ae-84c4-bbd2f40c9184-delete_snapshot" released by "delete_snapshot" :: held 2.888s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:50 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.411s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:50 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Deleted volume successfully. Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2cff0633-bdda-475c-b54f-938d52ba3314 tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-375bb236-d79b-4966-9a29-5f3c9b04787a-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:50 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-89651d26-161a-40d0-8ba1-4f75c2d633da" returned: 0 in 0.378s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.119s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894627084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17b1a9d-b85f-49dc-b928-a2b89124f51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fb275efda94a8bba366eef775f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:37Z,use_quota=True,user_id='02c84ee0786b47bba3bd35f00983de4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Creating volume a17b1a9d-b85f-49dc-b928-a2b89124f51a {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:50 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ee5322-68a9-49a0-b2f4-62bc28ceca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89651d26-161a-40d0-8ba1-4f75c2d633da', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:50 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a 1073741824 Sep 23 00:32:50 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1098b419-b2f1-41d7-a562-02788c7d864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:50 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume volume-89651d26-161a-40d0-8ba1-4f75c2d633da (89651d26-161a-40d0-8ba1-4f75c2d633da): created successfully Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1098b419-b2f1-41d7-a562-02788c7d864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Flow 'volume_create_manager' (ecd166aa-b6e3-4153-9f21-1a046f759a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:50 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4f930e45-8ad1-4429-9c63-8391c20f426f tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Created volume successfully. Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-31f25259-65d4-4e26-af78-84a1aa3cc489-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-31f25259-65d4-4e26-af78-84a1aa3cc489-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-31f25259-65d4-4e26-af78-84a1aa3cc489" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "cinder-c4f495a2-1179-47ac-9225-9b7eab7797f4-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-31f25259-65d4-4e26-af78-84a1aa3cc489" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-c4f495a2-1179-47ac-9225-9b7eab7797f4-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be8b28d-cd0a-4a92-95c5-ff9060941764]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "cinder-quobyte-c4f495a2-1179-47ac-9225-9b7eab7797f4" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-quobyte-c4f495a2-1179-47ac-9225-9b7eab7797f4" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb152ae-a426-46b3-aeb5-631e8e907d83]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:50 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 Sep 23 00:32:50 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:50 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a 1073741824" returned: 0 in 0.602s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:50 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4 Sep 23 00:32:50 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:50 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a Sep 23 00:32:50 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:51 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489" returned: 0 in 0.587s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:51 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4" returned: 0 in 0.494s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:51 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489 Sep 23 00:32:51 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:51 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4 Sep 23 00:32:51 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:51 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a" returned: 0 in 0.422s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.294s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-118124283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796888e5-e32e-4675-b9b2-f15730789aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10fb275efda94a8bba366eef775f6675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:38Z,use_quota=True,user_id='02c84ee0786b47bba3bd35f00983de4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Creating volume 796888e5-e32e-4675-b9b2-f15730789aa1 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:51 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-796888e5-e32e-4675-b9b2-f15730789aa1 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:51 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-796888e5-e32e-4675-b9b2-f15730789aa1 1073741824 Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38cbb9c-babf-45e7-ab17-22f2b4b4ae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:51 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31c4d45-e014-46d8-b910-7845b35ba172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:51 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a (a17b1a9d-b85f-49dc-b928-a2b89124f51a): created successfully Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31c4d45-e014-46d8-b910-7845b35ba172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Flow 'volume_create_manager' (1261bc0b-756b-4569-8f7b-259985e4054f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:51 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0817ab49-6ff2-4126-ab03-82a366d3b310 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Created volume successfully. Sep 23 00:32:51 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-31f25259-65d4-4e26-af78-84a1aa3cc489" returned: 0 in 0.324s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:51 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-c4f495a2-1179-47ac-9225-9b7eab7797f4" returned: 0 in 0.326s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-31f25259-65d4-4e26-af78-84a1aa3cc489" released by "delete_volume" :: held 1.027s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-quobyte-c4f495a2-1179-47ac-9225-9b7eab7797f4" released by "delete_volume" :: held 0.885s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Created reservations ['8c960308-0f6f-4492-83c9-94090b32a99b', '7ce472b2-89a6-4b01-bec7-8709f4a57dc5', 'faa14961-f895-451f-b519-ac696c26e56b', '979229c8-a1b9-4a09-86fc-c4cc57077fb5'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Created reservations ['1a10554f-e9a2-4715-92db-64fa4ccb2174', '550bbe2d-04cb-4106-9f64-b1955a5ec237', 'a972c5df-873d-426e-9003-7ef36a85fdc7', '1c540319-8b62-4492-a2cf-7ade77e71d7d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:51 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:51 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:51 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:51 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:51 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-796888e5-e32e-4675-b9b2-f15730789aa1 1073741824" returned: 0 in 0.692s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-796888e5-e32e-4675-b9b2-f15730789aa1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:52 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-796888e5-e32e-4675-b9b2-f15730789aa1 Sep 23 00:32:52 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:52 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.357s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:52 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Deleted volume successfully. Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-12c31541-cab6-48a4-b5a6-a6fcf5c8f910 tempest-VolumeDependencyTests-1730479762 None] Lock "cinder-c4f495a2-1179-47ac-9225-9b7eab7797f4-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:52 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.413s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:52 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Deleted volume successfully. Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4e34acfa-499a-4e0b-b73d-7399a1ce1cc6 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-31f25259-65d4-4e26-af78-84a1aa3cc489-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:52 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-796888e5-e32e-4675-b9b2-f15730789aa1" returned: 0 in 0.383s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.463s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10f8748-3fa8-415c-aa04-7d8b6506d1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48a4d6311a1d4be79ca01dc85d43eafd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:47Z,use_quota=True,user_id='ba4d7f4221c64be289a9990b71fb8261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Creating volume f10f8748-3fa8-415c-aa04-7d8b6506d1c7 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:52 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f78827-9980-430a-bffd-5b9f183f2ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-796888e5-e32e-4675-b9b2-f15730789aa1', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:52 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 1073741824 Sep 23 00:32:52 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dddff94a-e1cc-459c-8612-a96da961cc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:52 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Volume volume-796888e5-e32e-4675-b9b2-f15730789aa1 (796888e5-e32e-4675-b9b2-f15730789aa1): created successfully Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dddff94a-e1cc-459c-8612-a96da961cc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:52 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Flow 'volume_create_manager' (3a445560-7222-4ae4-9bcc-fb481eba1f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:52 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-917e63c9-bdaf-442e-b85d-852067f1a5f4 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Created volume successfully. Sep 23 00:32:53 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 1073741824" returned: 0 in 0.582s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:53 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 Sep 23 00:32:53 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:53 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Flow 'volume_create_manager' (8506113d-fbd7-4892-acec-0063299595fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5972b64d-8875-468f-a344-74dfaf98a30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7" returned: 0 in 0.383s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "cinder-796888e5-e32e-4675-b9b2-f15730789aa1-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5972b64d-8875-468f-a344-74dfaf98a30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474484693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c2fcf7-a261-47fc-bdfa-d12fc09f1e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b2dc3b9f7145a3ad3285542169a74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:53Z,use_quota=True,user_id='cc49c0a6d4e24be187ecdd3e940c22f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73cb87c-dbb8-4005-9675-490c63d7d07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73cb87c-dbb8-4005-9675-490c63d7d07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18338c50-acd9-45c6-b96d-0ec036822d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18338c50-acd9-45c6-b96d-0ec036822d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c2fcf7-a261-47fc-bdfa-d12fc09f1e72', 'volume_name': 'volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9663f6f-2de1-4a0d-a459-3b6e7c1e3596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9663f6f-2de1-4a0d-a459-3b6e7c1e3596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77ace45-bc77-4281-93e6-7ef751168452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:53 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Volume 08c2fcf7-a261-47fc-bdfa-d12fc09f1e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72', 'volume_size': 1} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474484693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c2fcf7-a261-47fc-bdfa-d12fc09f1e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b2dc3b9f7145a3ad3285542169a74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:53Z,use_quota=True,user_id='cc49c0a6d4e24be187ecdd3e940c22f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Creating volume 08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:53 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-796888e5-e32e-4675-b9b2-f15730789aa1-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Attempting download of b4b50218-c594-4744-b176-250be7f2eac1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4b50218-c594-4744-b176-250be7f2eac1', 'metadata': {}}])) to volume f10f8748-3fa8-415c-aa04-7d8b6506d1c7. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:32:53 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 1073741824 Sep 23 00:32:53 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "cinder-quobyte-796888e5-e32e-4675-b9b2-f15730789aa1" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-quobyte-796888e5-e32e-4675-b9b2-f15730789aa1" acquired by "delete_volume" :: waited 0.037s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[615fc6d2-4ae2-4a33-8b96-57803cd67dd9]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4b50218-c594-4744-b176-250be7f2eac1_54ngyxss {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[418a415e-6c71-4c73-9433-1053e3749b5f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-796888e5-e32e-4675-b9b2-f15730789aa1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:53 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4b50218-c594-4744-b176-250be7f2eac1_54ngyxss Sep 23 00:32:53 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:53 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-796888e5-e32e-4675-b9b2-f15730789aa1 Sep 23 00:32:53 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:54 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4b50218-c594-4744-b176-250be7f2eac1_54ngyxss" returned: 0 in 0.509s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4b50218-c594-4744-b176-250be7f2eac1_54ngyxss {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:54 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 1073741824" returned: 0 in 0.753s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:54 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4b50218-c594-4744-b176-250be7f2eac1_54ngyxss Sep 23 00:32:54 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:54 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 Sep 23 00:32:54 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:54 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-796888e5-e32e-4675-b9b2-f15730789aa1" returned: 0 in 0.781s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-796888e5-e32e-4675-b9b2-f15730789aa1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:54 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-796888e5-e32e-4675-b9b2-f15730789aa1 Sep 23 00:32:54 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:54 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72" returned: 0 in 0.361s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:54 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4b50218-c594-4744-b176-250be7f2eac1_54ngyxss" returned: 1 in 0.554s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4b50218-c594-4744-b176-250be7f2eac1_54ngyxss' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a8fdb-872f-40f4-8162-a89e541bbeba]: (4, 'raw') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77ace45-bc77-4281-93e6-7ef751168452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0718bcd2-df2f-4423-ab6c-a1cbb1b2f788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:54 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Volume volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 (08c2fcf7-a261-47fc-bdfa-d12fc09f1e72): created successfully Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0718bcd2-df2f-4423-ab6c-a1cbb1b2f788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Flow 'volume_create_manager' (8506113d-fbd7-4892-acec-0063299595fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:54 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-fc34f735-4cc8-4491-9f68-f88cefe5783f tempest-ProjectReaderTests-1021144341 None] Created volume successfully. Sep 23 00:32:54 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-796888e5-e32e-4675-b9b2-f15730789aa1" returned: 0 in 0.421s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:54 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD Sep 23 00:32:54 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:54 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-quobyte-796888e5-e32e-4675-b9b2-f15730789aa1" released by "delete_volume" :: held 1.272s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Created reservations ['71e99768-f760-4c0e-81ad-1b385cf0c522', '9fe7db75-883b-49d7-87e9-9135535cd278', 'c6b79f33-6c62-425b-9b9b-d0e4a347328c', '460947ab-4c9d-4a77-8033-1a9ba50a742d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:55 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:55 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD" returned: 0 in 0.497s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:55 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD Sep 23 00:32:55 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.338s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:55 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Deleted volume successfully. Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3ff3a666-e305-4153-a275-e4f7b13f23de tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-796888e5-e32e-4675-b9b2-f15730789aa1-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] Creating offline snapshot 7ee08392-91df-46ec-8726-626a137ca593 of volume 08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[788752e3-a2c4-4d75-bdbc-39dd7c72faea]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "cinder-a17b1a9d-b85f-49dc-b928-a2b89124f51a-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:55 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-a17b1a9d-b85f-49dc-b928-a2b89124f51a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD" returned: 1 in 0.608s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] b4b50218-c594-4744-b176-250be7f2eac1 was raw, converting to qcow2 {{(pid=86481) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:55 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 Sep 23 00:32:55 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 Sep 23 00:32:55 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "cinder-quobyte-a17b1a9d-b85f-49dc-b928-a2b89124f51a" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-quobyte-a17b1a9d-b85f-49dc-b928-a2b89124f51a" acquired by "delete_volume" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[869fc90c-cd16-4d0d-b924-440d8a1a5e24]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:56 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a Sep 23 00:32:56 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:56 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72" returned: 0 in 0.523s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:56 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 1G Sep 23 00:32:56 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:56 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a" returned: 0 in 0.475s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:56 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7" returned: 0 in 0.630s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4b50218-c594-4744-b176-250be7f2eac1_iwsinfjmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:32:56 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:56 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a Sep 23 00:32:56 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:56 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 1G Sep 23 00:32:56 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:56 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a17b1a9d-b85f-49dc-b928-a2b89124f51a" returned: 0 in 0.349s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-quobyte-a17b1a9d-b85f-49dc-b928-a2b89124f51a" released by "delete_volume" :: held 0.882s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:56 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 1G" returned: 0 in 0.584s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:56 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 Sep 23 00:32:56 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:56 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Created reservations ['fcd10f0d-74b8-40a8-9e03-75616276ccf0', 'e5eea006-adc5-46d0-96a1-33286cb646b7', 'd3f9504a-3f8b-49c6-b5cf-e8e4e5f1d760', '90d36b6c-2d3f-48d9-ae4e-0d14b5b4ab05'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:57 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 1G" returned: 0 in 0.556s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Downloaded image b4b50218-c594-4744-b176-250be7f2eac1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4b50218-c594-4744-b176-250be7f2eac1', 'metadata': {}}])) to volume f10f8748-3fa8-415c-aa04-7d8b6506d1c7 successfully. {{(pid=86481) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Temporary image b4b50218-c594-4744-b176-250be7f2eac1 for user ba4d7f4221c64be289a9990b71fb8261 is deleted. {{(pid=86481) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.volume.volume_utils [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Marking volume f10f8748-3fa8-415c-aa04-7d8b6506d1c7 as bootable. {{(pid=86481) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Copying metadata from image b4b50218-c594-4744-b176-250be7f2eac1 to f10f8748-3fa8-415c-aa04-7d8b6506d1c7. {{(pid=86481) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Creating volume glance metadata for volume f10f8748-3fa8-415c-aa04-7d8b6506d1c7 backed by image b4b50218-c594-4744-b176-250be7f2eac1 with: {'image_id': 'b4b50218-c594-4744-b176-250be7f2eac1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '10c79596ec4503f82395c17d118a8e7f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86481) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:57 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:57 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70c3792-9270-4269-88b8-202fc9cc9bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7', 'volume_size': 1, 'image_id': 'b4b50218-c594-4744-b176-250be7f2eac1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4b50218-c594-4744-b176-250be7f2eac1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '10c79596ec4503f82395c17d118a8e7f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '48a4d6311a1d4be79ca01dc85d43eafd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '938d993262ccba0157fa5b623b34ee1e144dfbfe6e1d8e0ad8c8bae8f26fb207fd8319b133fca687ef0a36642d47fcd7620873b658c20fc327ff3c2b5b1a8cbb', 'id': 'b4b50218-c594-4744-b176-250be7f2eac1', 'created_at': datetime.datetime(2026, 9, 22, 22, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4b50218-c594-4744-b176-250be7f2eac1/file', 'properties': {}}, 'image_service': }' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b99eff9-65d3-4ba8-8bb6-7b14f29f9f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:57 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Volume volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 (f10f8748-3fa8-415c-aa04-7d8b6506d1c7): created successfully Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b99eff9-65d3-4ba8-8bb6-7b14f29f9f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Flow 'volume_create_manager' (623fbbd9-f92e-404c-b78b-3453f7348546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:57 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-243704cd-d081-45d4-a3b1-4c15ef9f8391 tempest-VolumeImageDependencyTests-634775992 None] Created volume successfully. Sep 23 00:32:57 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593" returned: 0 in 0.432s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:57 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 is being set with open permissions: ugo+rw Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:57 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 Sep 23 00:32:57 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:57 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.297s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:57 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Deleted volume successfully. Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b2d1fa8c-0277-4256-8e70-65a5dba5e2e1 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-a17b1a9d-b85f-49dc-b928-a2b89124f51a-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:57 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593" returned: 0 in 0.303s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:57 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.info Sep 23 00:32:57 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Acquiring lock "cinder-f10f8748-3fa8-415c-aa04-7d8b6506d1c7-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Lock "cinder-f10f8748-3fa8-415c-aa04-7d8b6506d1c7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Acquiring lock "cinder-quobyte-f10f8748-3fa8-415c-aa04-7d8b6506d1c7" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Lock "cinder-quobyte-f10f8748-3fa8-415c-aa04-7d8b6506d1c7" acquired by "delete_volume" :: waited 0.016s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:58 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.info" returned: 0 in 0.373s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.info is being set with open permissions: ugo+rw Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77c1a90-6b03-4e14-b074-671e27cef793]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.info Sep 23 00:32:58 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "cinder-89651d26-161a-40d0-8ba1-4f75c2d633da-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-89651d26-161a-40d0-8ba1-4f75c2d633da-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=177,cinder:UPDATE=238,cinder:INSERT=75,cinder:DELETE=32 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:58 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 Sep 23 00:32:58 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "cinder-quobyte-89651d26-161a-40d0-8ba1-4f75c2d633da" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-quobyte-89651d26-161a-40d0-8ba1-4f75c2d633da" acquired by "delete_volume" :: waited 0.040s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd1b448-a8ef-45e5-a61d-cbb513cf16e9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-89651d26-161a-40d0-8ba1-4f75c2d633da {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.info" returned: 0 in 0.426s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=260,cinder:SELECT=198,cinder:INSERT=61,cinder:DELETE=14 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:58 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-89651d26-161a-40d0-8ba1-4f75c2d633da Sep 23 00:32:58 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e28a9c53-6461-4636-928e-752a369cb1ed tempest-ProjectReaderTests-1021144341 None] Create snapshot completed successfully Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (0de09109-8637-4677-b2b0-d3b3078b3332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d340fe91-87c7-4b12-8d90-3e7612f87edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:58 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d340fe91-87c7-4b12-8d90-3e7612f87edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828348698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b357d4d7-32e2-4b10-b7ce-6b6303229443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:58Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081c826b-8125-4fff-b68b-571242ae8e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081c826b-8125-4fff-b68b-571242ae8e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e401b2-053b-4205-ad1c-8007195c8092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e401b2-053b-4205-ad1c-8007195c8092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b357d4d7-32e2-4b10-b7ce-6b6303229443', 'volume_name': 'volume-b357d4d7-32e2-4b10-b7ce-6b6303229443', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90efc73-d689-45fc-9a98-7e7462f4f2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90efc73-d689-45fc-9a98-7e7462f4f2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e716e47-bc80-4af6-86f4-f461be3781a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:58 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Volume b357d4d7-32e2-4b10-b7ce-6b6303229443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b357d4d7-32e2-4b10-b7ce-6b6303229443', 'volume_size': 1} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828348698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b357d4d7-32e2-4b10-b7ce-6b6303229443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:58Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Creating volume b357d4d7-32e2-4b10-b7ce-6b6303229443 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:58 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7" returned: 0 in 0.598s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 1073741824 Sep 23 00:32:58 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7 Sep 23 00:32:58 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-89651d26-161a-40d0-8ba1-4f75c2d633da" returned: 0 in 0.435s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-89651d26-161a-40d0-8ba1-4f75c2d633da {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-89651d26-161a-40d0-8ba1-4f75c2d633da Sep 23 00:32:58 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-7ee08392-91df-46ec-8726-626a137ca593-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:59 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-f10f8748-3fa8-415c-aa04-7d8b6506d1c7" returned: 0 in 0.363s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-7ee08392-91df-46ec-8726-626a137ca593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Lock "cinder-quobyte-f10f8748-3fa8-415c-aa04-7d8b6506d1c7" released by "delete_volume" :: held 1.063s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-7ee08392-91df-46ec-8726-626a137ca593" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-7ee08392-91df-46ec-8726-626a137ca593" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Deleting offline snapshot 7ee08392-91df-46ec-8726-626a137ca593 of volume 08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] snapshot_file for this snap is: volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7583b17d-0faf-4d92-9dc5-20db85802f9c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:59 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-89651d26-161a-40d0-8ba1-4f75c2d633da" returned: 0 in 0.380s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-quobyte-89651d26-161a-40d0-8ba1-4f75c2d633da" released by "delete_volume" :: held 0.901s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Created reservations ['5500dde3-1502-4b58-86ca-7fd3f2da6314', '0109eb89-f91b-4b37-bf3d-f1e87efa89e0', 'f5909218-8f0b-4a90-808d-98efa0fd5cbd', 'c6061b8b-450b-4725-91b2-eb708b7d42f8'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:59 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 1073741824" returned: 0 in 0.612s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 Sep 23 00:32:59 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:59 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 Sep 23 00:32:59 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Created reservations ['45189242-ba55-44de-829b-f6b1ef772ad3', '48e238df-8223-4e2d-9738-6fef4b4cc9ce', '328d3509-fc3b-4510-9a9f-b55aede7c717', 'c373345c-7341-48d8-b672-623fb9247589'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:32:59 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:59 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:59 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:32:59 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:59 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443" returned: 0 in 0.399s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:59 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593" returned: 0 in 0.552s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[97071497-aaff-4008-89ff-78adcdcaeabf]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e716e47-bc80-4af6-86f4-f461be3781a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b357d4d7-32e2-4b10-b7ce-6b6303229443', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d5cced-5cd7-4628-a32f-2a7634d3455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:59 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Volume volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 (b357d4d7-32e2-4b10-b7ce-6b6303229443): created successfully Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d5cced-5cd7-4628-a32f-2a7634d3455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (0de09109-8637-4677-b2b0-d3b3078b3332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-229e8502-0daf-472d-81d8-1ecae8935942 tempest-ProjectMemberTests-1420876395 None] Created volume successfully. Sep 23 00:32:59 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.454s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Deleted volume successfully. Sep 23 00:32:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e3c1524a-95c0-410d-9f93-5fa307acc5fc tempest-VolumeImageDependencyTests-634775992 None] Lock "cinder-f10f8748-3fa8-415c-aa04-7d8b6506d1c7-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:59 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 Sep 23 00:32:59 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:00 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.355s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:00 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Deleted volume successfully. Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2139d29a-6ed2-47f9-89e5-92c71aa698fb tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-89651d26-161a-40d0-8ba1-4f75c2d633da-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:00 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72" returned: 0 in 0.496s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:00 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 Sep 23 00:33:00 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "cinder-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "cinder-quobyte-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-quobyte-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d76c2f9-8ecb-4216-8246-449c45afe632]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:00 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593" returned: 0 in 0.619s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:00 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593 Sep 23 00:33:00 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:01 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83 Sep 23 00:33:01 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] Creating offline snapshot 25482ffa-d42c-4e67-9b17-5faa17e45532 of volume b357d4d7-32e2-4b10-b7ce-6b6303229443 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:01 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72.7ee08392-91df-46ec-8726-626a137ca593" returned: 0 in 0.498s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ea9c7f-dd12-41fe-a16d-0820eb1b77af]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-7ee08392-91df-46ec-8726-626a137ca593" released by "_delete_snapshot" :: held 2.315s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:01 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72" released by "delete_snapshot" :: held 2.359s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83" returned: 0 in 0.630s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:01 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83 Sep 23 00:33:01 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Created reservations ['f00fff43-49b2-439e-b10b-554f55597337', 'c2293ade-2d35-4a13-b798-e6a9f3e84e7d', '8c6d9755-00a1-43bd-b293-538eb0e5159d', '4519dfcf-f4da-44f4-925f-a549a5ad1418'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:01 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 Sep 23 00:33:01 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:01 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Delete snapshot completed successfully. Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21ff566b-b508-4668-8581-7a2bf37d3cf2 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-7ee08392-91df-46ec-8726-626a137ca593-delete_snapshot" released by "delete_snapshot" :: held 2.605s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:01 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83" returned: 0 in 0.343s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-quobyte-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83" released by "delete_volume" :: held 1.046s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Created reservations ['36db2665-d5b1-4f54-a7f7-7b1a163ebb36', '585a111b-a5e7-42d5-af8c-c1c07d985c51', 'de3fe459-2011-4070-9e94-b3304169f0d3', 'd1904470-c406-477e-8a21-04ef262e0f7b'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:01 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443" returned: 0 in 0.522s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:02 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 1G Sep 23 00:33:02 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:02 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:02 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Lock "cinder-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:02 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ca68a8-43e2-4448-bbc9-aac09c0a3310]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.408s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:02 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Deleted volume successfully. Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-21d70664-9488-4122-a6f7-717e7083cfe3 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-e48247c9-a3ac-44c1-8ebf-4a7d4fb97d83-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:02 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 Sep 23 00:33:02 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:02 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 1G" returned: 0 in 0.643s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:02 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 Sep 23 00:33:02 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:02 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72" returned: 0 in 0.468s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:02 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72 Sep 23 00:33:02 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:02 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532" returned: 0 in 0.365s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:02 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 is being set with open permissions: ugo+rw Sep 23 00:33:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:03 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 Sep 23 00:33:03 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "cinder-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "cinder-quobyte-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-quobyte-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15" acquired by "delete_volume" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2ef003-6487-4284-8c1c-764e8494eb29]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:03 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72" returned: 0 in 0.372s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72" released by "delete_volume" :: held 0.932s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:03 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532" returned: 0 in 0.373s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:03 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15 Sep 23 00:33:03 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Created reservations ['e5b9fe9d-843c-4540-b6c0-38153652ab16', '90d54396-2657-43cc-a4d7-a268b5e6718e', '83f0177f-d6c4-4ef5-a575-d54656e693e3', 'af3ab730-5805-45a6-883b-ad1d2355f39d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:03 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.info Sep 23 00:33:03 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:03 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:03 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:03 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15" returned: 0 in 0.580s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:03 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15 Sep 23 00:33:03 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:03 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.info" returned: 0 in 0.482s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:03 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.info is being set with open permissions: ugo+rw Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:03 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.373s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:03 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:03 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.info Sep 23 00:33:03 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:03 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Deleted volume successfully. Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fe936b75-2da5-4bad-b1ef-860c29ed031d tempest-ProjectReaderTests-1021144341 None] Lock "cinder-08c2fcf7-a261-47fc-bdfa-d12fc09f1e72-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:04 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.info" returned: 0 in 0.392s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:04 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.912s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15" returned: 0 in 0.494s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Flow 'volume_create_manager' (bea42960-a4c0-4cf6-8a9e-47533c9d2171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3660216e-cff4-4aaa-b495-c16ad762dce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-quobyte-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15" released by "delete_volume" :: held 1.179s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:04 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4f5d84c2-8448-4ec9-8bd5-13af0d397afc tempest-ProjectMemberTests-1420876395 None] Create snapshot completed successfully Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3660216e-cff4-4aaa-b495-c16ad762dce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-199480725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6d3953-8553-4a68-981f-2439bfb85315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b2dc3b9f7145a3ad3285542169a74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:04Z,use_quota=True,user_id='cc49c0a6d4e24be187ecdd3e940c22f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cee59e-3be6-45f5-9175-f8239b5595a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cee59e-3be6-45f5-9175-f8239b5595a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2a168f-8716-46cb-b230-a9032654f488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2a168f-8716-46cb-b230-a9032654f488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f6d3953-8553-4a68-981f-2439bfb85315', 'volume_name': 'volume-5f6d3953-8553-4a68-981f-2439bfb85315', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a63c187-c3dc-4ea2-a36c-728816be7478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a63c187-c3dc-4ea2-a36c-728816be7478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530376b8-101a-47cb-b9f0-4997e13c61d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:04 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Volume 5f6d3953-8553-4a68-981f-2439bfb85315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f6d3953-8553-4a68-981f-2439bfb85315', 'volume_size': 1} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-199480725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6d3953-8553-4a68-981f-2439bfb85315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b2dc3b9f7145a3ad3285542169a74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:04Z,use_quota=True,user_id='cc49c0a6d4e24be187ecdd3e940c22f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Creating volume 5f6d3953-8553-4a68-981f-2439bfb85315 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:04 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:04 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 1073741824 Sep 23 00:33:04 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Created reservations ['72900a66-5f93-4b55-9532-f5854d12168c', '3a60eae4-2385-41ba-b4c7-8f1e4ceb8659', 'a57ae5fa-c5af-4431-9d17-e4be0a6fc03a', '661e4fd6-8f5d-4fb7-96b0-14ca869bdb25'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-25482ffa-d42c-4e67-9b17-5faa17e45532-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-25482ffa-d42c-4e67-9b17-5faa17e45532-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-b357d4d7-32e2-4b10-b7ce-6b6303229443" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:04 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:04 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-b357d4d7-32e2-4b10-b7ce-6b6303229443" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-25482ffa-d42c-4e67-9b17-5faa17e45532" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-25482ffa-d42c-4e67-9b17-5faa17e45532" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Deleting offline snapshot 25482ffa-d42c-4e67-9b17-5faa17e45532 of volume b357d4d7-32e2-4b10-b7ce-6b6303229443 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] snapshot_file for this snap is: volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d91cb92-db7b-4a85-b3b8-fcbe926d18cb]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:04 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 Sep 23 00:33:04 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.428s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:05 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 1073741824" returned: 0 in 0.656s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Deleted volume successfully. Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4a81c492-b95e-4aad-8a0c-32e49e322020 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-cf544c2f-08d9-4cb7-b5e8-5f7c9847ad15-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 Sep 23 00:33:05 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:05 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Flow 'volume_create_manager' (83f67d4e-0915-4b98-9b47-b0420c8103e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd47fed-8782-49ce-aca0-6dbb5c2ecfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532" returned: 0 in 0.546s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b357d4d7-32e2-4b10-b7ce-6b6303229443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd47fed-8782-49ce-aca0-6dbb5c2ecfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dc8654-ce6e-4326-be19-d7433a9cd746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d37ba7e9f74aaf991fa4dacf532f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:05Z,use_quota=True,user_id='c90056e19f79425a9c1b9b5e55e54786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65cb6b1-5001-41cd-bcf3-a1cb0a7928e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65cb6b1-5001-41cd-bcf3-a1cb0a7928e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28de7d2f-ecf6-4f54-b90a-6f6bcb0af6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28de7d2f-ecf6-4f54-b90a-6f6bcb0af6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0dc8654-ce6e-4326-be19-d7433a9cd746', 'volume_name': 'volume-e0dc8654-ce6e-4326-be19-d7433a9cd746', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e2b860-747f-4481-bad9-72aa303cbc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e2b860-747f-4481-bad9-72aa303cbc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89198d7-438a-4edb-a194-33f1c4e91717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Volume e0dc8654-ce6e-4326-be19-d7433a9cd746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0dc8654-ce6e-4326-be19-d7433a9cd746', 'volume_size': 1} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccb59b1-f69d-4cc2-9cfb-3714c5a8b6a5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "cinder-ac376f77-82c5-4f2a-b750-01628b71aebc-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-ac376f77-82c5-4f2a-b750-01628b71aebc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "cinder-quobyte-ac376f77-82c5-4f2a-b750-01628b71aebc" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:05 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315" returned: 0 in 0.353s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-quobyte-ac376f77-82c5-4f2a-b750-01628b71aebc" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.111s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dc8654-ce6e-4326-be19-d7433a9cd746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d37ba7e9f74aaf991fa4dacf532f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:05Z,use_quota=True,user_id='c90056e19f79425a9c1b9b5e55e54786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Creating volume e0dc8654-ce6e-4326-be19-d7433a9cd746 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:05 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e0dc8654-ce6e-4326-be19-d7433a9cd746 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9088c581-9928-4fff-b5c4-436fdcfb2492]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac376f77-82c5-4f2a-b750-01628b71aebc {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 Sep 23 00:33:05 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e0dc8654-ce6e-4326-be19-d7433a9cd746 1073741824 Sep 23 00:33:05 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530376b8-101a-47cb-b9f0-4997e13c61d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f6d3953-8553-4a68-981f-2439bfb85315', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1ea70c-2ab6-48ba-9012-9467000e447d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:05 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Volume volume-5f6d3953-8553-4a68-981f-2439bfb85315 (5f6d3953-8553-4a68-981f-2439bfb85315): created successfully Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1ea70c-2ab6-48ba-9012-9467000e447d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Flow 'volume_create_manager' (bea42960-a4c0-4cf6-8a9e-47533c9d2171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:05 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1f6ba91b-392b-4c27-8370-3b3439444e89 tempest-ProjectReaderTests-1021144341 None] Created volume successfully. Sep 23 00:33:05 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac376f77-82c5-4f2a-b750-01628b71aebc Sep 23 00:33:05 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443" returned: 0 in 0.473s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 Sep 23 00:33:05 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac376f77-82c5-4f2a-b750-01628b71aebc" returned: 0 in 0.476s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac376f77-82c5-4f2a-b750-01628b71aebc {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:06 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac376f77-82c5-4f2a-b750-01628b71aebc Sep 23 00:33:06 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e0dc8654-ce6e-4326-be19-d7433a9cd746 1073741824" returned: 0 in 0.553s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e0dc8654-ce6e-4326-be19-d7433a9cd746 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:06 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e0dc8654-ce6e-4326-be19-d7433a9cd746 Sep 23 00:33:06 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ac376f77-82c5-4f2a-b750-01628b71aebc" returned: 0 in 0.377s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-quobyte-ac376f77-82c5-4f2a-b750-01628b71aebc" released by "delete_volume" :: held 0.926s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:06 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532" returned: 0 in 0.567s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:06 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e0dc8654-ce6e-4326-be19-d7433a9cd746" returned: 0 in 0.356s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:06 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532 Sep 23 00:33:06 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89198d7-438a-4edb-a194-33f1c4e91717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0dc8654-ce6e-4326-be19-d7433a9cd746', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bf84db-58c9-4fd3-9de0-e2c6f53f6724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Created reservations ['b8202954-5308-4ccb-a147-95fd369e3c51', '99c19996-0234-4a7e-b3d4-a64694bfd4f0', '303da94c-b284-4f45-9c7f-136efc554e73', '6bc9c8f3-2c42-43e9-b917-fbb39647547b'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:06 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Volume volume-e0dc8654-ce6e-4326-be19-d7433a9cd746 (e0dc8654-ce6e-4326-be19-d7433a9cd746): created successfully Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bf84db-58c9-4fd3-9de0-e2c6f53f6724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Flow 'volume_create_manager' (83f67d4e-0915-4b98-9b47-b0420c8103e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:06 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-67f70583-b30a-46e1-b997-6c3d005f245d tempest-CinderUnicodeTest-430341257 None] Created volume successfully. Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:06 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:06 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] Creating offline snapshot 5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd of volume 5f6d3953-8553-4a68-981f-2439bfb85315 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edab610-031e-4dbb-b7e3-cb5f17cb6483]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:06 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443.25482ffa-d42c-4e67-9b17-5faa17e45532" returned: 0 in 0.430s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-25482ffa-d42c-4e67-9b17-5faa17e45532" released by "_delete_snapshot" :: held 2.222s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:06 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-b357d4d7-32e2-4b10-b7ce-6b6303229443" released by "delete_snapshot" :: held 2.254s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:06 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 Sep 23 00:33:06 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:07 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Created reservations ['dda379a0-e239-4ce5-883e-b315ab0289b6', '62f7401c-19c9-489a-be5b-c8f470621b2d', 'cac403a8-8c34-45f0-b745-eaab9145d515', 'c1ff4739-b4da-430a-ad9e-cafda01e86bc'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:07 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Delete snapshot completed successfully. Sep 23 00:33:07 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-eb2ab7d1-5c00-4464-af9e-666a400b4d0c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-25482ffa-d42c-4e67-9b17-5faa17e45532-delete_snapshot" released by "delete_snapshot" :: held 2.438s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.354s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:07 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:07 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Deleted volume successfully. Sep 23 00:33:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-717372f7-e406-453e-83b1-2d3301b09091 tempest-CreateVolumesFromSourceVolumeTest-2069770109 None] Lock "cinder-ac376f77-82c5-4f2a-b750-01628b71aebc-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:07 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315" returned: 0 in 0.481s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd 1G Sep 23 00:33:07 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:07 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd 1G" returned: 0 in 0.636s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:07 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6d3953-8553-4a68-981f-2439bfb85315 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-b357d4d7-32e2-4b10-b7ce-6b6303229443-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:08 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6d3953-8553-4a68-981f-2439bfb85315 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd Sep 23 00:33:08 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Lock "cinder-b357d4d7-32e2-4b10-b7ce-6b6303229443-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-b357d4d7-32e2-4b10-b7ce-6b6303229443" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-b357d4d7-32e2-4b10-b7ce-6b6303229443" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f30e98-2081-4915-bfa8-f04fc51d6b78]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Flow 'volume_create_manager' (ec108b6d-c483-41e5-abec-1f15b7136900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bf0c8f-b26d-45a2-b2cb-ab2d3aae1dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bf0c8f-b26d-45a2-b2cb-ab2d3aae1dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1242496019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d73c97-b2e3-4ef8-8259-46347e4bb1a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d37ba7e9f74aaf991fa4dacf532f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:08Z,use_quota=True,user_id='c90056e19f79425a9c1b9b5e55e54786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (becb38e4-a025-49cf-ad5a-79ff7eca86fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (becb38e4-a025-49cf-ad5a-79ff7eca86fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514ec680-ac29-42ec-bbdc-dd73642a85dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514ec680-ac29-42ec-bbdc-dd73642a85dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d73c97-b2e3-4ef8-8259-46347e4bb1a3', 'volume_name': 'volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7783720d-f922-487f-b425-9e5556fda9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7783720d-f922-487f-b425-9e5556fda9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c82a3a-a4f1-4a59-9062-ac7b367b2e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:08 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Volume 76d73c97-b2e3-4ef8-8259-46347e4bb1a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3', 'volume_size': 1} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:08 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 Sep 23 00:33:08 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6d3953-8553-4a68-981f-2439bfb85315 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd" returned: 0 in 0.456s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd is being set with open permissions: ugo+rw Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd Sep 23 00:33:08 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443" returned: 0 in 0.477s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443 Sep 23 00:33:08 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd" returned: 0 in 0.454s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:08 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.info Sep 23 00:33:08 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:09 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-b357d4d7-32e2-4b10-b7ce-6b6303229443" returned: 0 in 0.388s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-b357d4d7-32e2-4b10-b7ce-6b6303229443" released by "delete_volume" :: held 1.004s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Created reservations ['b16d3765-203b-49aa-8895-26132123dbcf', '4d0a923d-9036-4f9f-aeb2-0217e6131643', '155674bc-9d59-420a-9de3-dda2c8c947dc', 'b7a7da45-1468-4857-91b5-dd86c69e80a0'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:09 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.info" returned: 0 in 0.400s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.info is being set with open permissions: ugo+rw Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:09 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:09 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:09 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.info Sep 23 00:33:09 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:09 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.info" returned: 0 in 0.308s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.881s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:09 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.320s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1242496019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d73c97-b2e3-4ef8-8259-46347e4bb1a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1d37ba7e9f74aaf991fa4dacf532f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:08Z,use_quota=True,user_id='c90056e19f79425a9c1b9b5e55e54786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Creating volume 76d73c97-b2e3-4ef8-8259-46347e4bb1a3 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:09 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.405s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:09 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 1073741824 Sep 23 00:33:09 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Deleted volume successfully. Sep 23 00:33:09 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:09 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-8379b83b-b178-4ee6-ae9c-6bc3b44965ac tempest-ProjectReaderTests-1021144341 None] Create snapshot completed successfully Sep 23 00:33:09 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-866f1b34-857f-41d6-9fd3-5730465eefec tempest-ProjectMemberTests-1420876395 None] Lock "cinder-b357d4d7-32e2-4b10-b7ce-6b6303229443-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-5f6d3953-8553-4a68-981f-2439bfb85315" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-5f6d3953-8553-4a68-981f-2439bfb85315" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Deleting offline snapshot 5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd of volume 5f6d3953-8553-4a68-981f-2439bfb85315 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] snapshot_file for this snap is: volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89f2bcc-6a0d-4f78-be7e-7dfa03cbcebe]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:10 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd Sep 23 00:33:10 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:10 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 1073741824" returned: 0 in 0.782s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:10 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 Sep 23 00:33:10 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:10 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd" returned: 0 in 0.635s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f6d3953-8553-4a68-981f-2439bfb85315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[33853ba9-35b4-4f9e-ad29-36d7b0622215]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3" returned: 0 in 0.496s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:11 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 Sep 23 00:33:11 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c82a3a-a4f1-4a59-9062-ac7b367b2e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd63fea7-c8be-401b-a73c-06b77d08215b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Volume volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 (76d73c97-b2e3-4ef8-8259-46347e4bb1a3): created successfully Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd63fea7-c8be-401b-a73c-06b77d08215b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Flow 'volume_create_manager' (ec108b6d-c483-41e5-abec-1f15b7136900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (a2ff2d0d-2638-4367-92c5-69f5111c79e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c08e86-b2b2-4d7c-85d7-6989810cf8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:11 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-176ec9a3-70bb-4fab-b61e-5ace88bfb6db tempest-CinderUnicodeTest-430341257 None] Created volume successfully. Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c08e86-b2b2-4d7c-85d7-6989810cf8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913416059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1131fbf-76eb-4f59-a101-b58031914dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:11Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efeedda-e1a3-463a-9e99-88d56bf335dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efeedda-e1a3-463a-9e99-88d56bf335dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acca425-4dfd-4924-ba61-17704765ecf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acca425-4dfd-4924-ba61-17704765ecf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1131fbf-76eb-4f59-a101-b58031914dff', 'volume_name': 'volume-a1131fbf-76eb-4f59-a101-b58031914dff', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5505290-d437-4032-b5de-b606ef217ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5505290-d437-4032-b5de-b606ef217ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dad5ef7-e4ce-4cc1-b9e1-df84ce24660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Volume a1131fbf-76eb-4f59-a101-b58031914dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1131fbf-76eb-4f59-a101-b58031914dff', 'volume_size': 1} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913416059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1131fbf-76eb-4f59-a101-b58031914dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:11Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Creating volume a1131fbf-76eb-4f59-a101-b58031914dff {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:11 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff 1073741824 Sep 23 00:33:11 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315" returned: 0 in 0.613s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd Sep 23 00:33:11 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:11 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff 1073741824" returned: 0 in 0.660s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:12 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff Sep 23 00:33:12 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:12 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd" returned: 0 in 0.608s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:12 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd Sep 23 00:33:12 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:12 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff" returned: 0 in 0.382s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.636s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dad5ef7-e4ce-4cc1-b9e1-df84ce24660f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1131fbf-76eb-4f59-a101-b58031914dff', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e6cf172-48b0-4aa4-8c79-0c51d31d625c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] Creating offline snapshot 97707646-ed63-43b5-b7c1-06e46ce63480 of volume 76d73c97-b2e3-4ef8-8259-46347e4bb1a3 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:12 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Volume volume-a1131fbf-76eb-4f59-a101-b58031914dff (a1131fbf-76eb-4f59-a101-b58031914dff): created successfully Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e6cf172-48b0-4aa4-8c79-0c51d31d625c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (a2ff2d0d-2638-4367-92c5-69f5111c79e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca05ca6b-6f69-42a4-b14f-01446b0cb446]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:12 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315.5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd" returned: 0 in 0.346s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:12 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-65b22bce-7053-4296-9490-142ae6c9a12d tempest-ProjectMemberTests-1420876395 None] Created volume successfully. Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd" released by "_delete_snapshot" :: held 2.388s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-5f6d3953-8553-4a68-981f-2439bfb85315" released by "delete_snapshot" :: held 2.424s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Created reservations ['600e6f9b-9282-45e7-a307-46be95554fce', 'ae94462b-53b0-4a6e-b5e5-9cb7b8932d7c', 'b397cbd2-eff2-429b-8f5e-75edaf2b588c', '37c491a5-1b17-41ad-9286-d92a98a4d658'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:12 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 Sep 23 00:33:12 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:12 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Delete snapshot completed successfully. Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-1cbbd2cc-84a6-4bd4-bc86-2b814a104965 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-5055b8dc-f8e2-4baf-bd47-7e73b69bd0bd-delete_snapshot" released by "delete_snapshot" :: held 2.624s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-9c337411-620d-4aec-b76c-f0f97239ec01 tempest-ProjectAdminTests-131630877 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5221061706543, 'free_capacity_gb': 1775.5221061706543, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86481) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:33:12 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3" returned: 0 in 0.506s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:13 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 1G Sep 23 00:33:13 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-5f6d3953-8553-4a68-981f-2439bfb85315-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Lock "cinder-5f6d3953-8553-4a68-981f-2439bfb85315-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-5f6d3953-8553-4a68-981f-2439bfb85315" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:13 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-5f6d3953-8553-4a68-981f-2439bfb85315" acquired by "delete_volume" :: waited 0.018s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:13 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 1G" returned: 0 in 0.627s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:13 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b76a196-8734-46c8-a76b-977bd1c67f81]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:13 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 Sep 23 00:33:13 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:13 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 Sep 23 00:33:13 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480" returned: 0 in 0.420s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:14 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 is being set with open permissions: ugo+rw Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:14 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 Sep 23 00:33:14 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315" returned: 0 in 0.498s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:14 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315 Sep 23 00:33:14 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480" returned: 0 in 0.333s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:14 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.info Sep 23 00:33:14 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-5f6d3953-8553-4a68-981f-2439bfb85315" returned: 0 in 0.343s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-5f6d3953-8553-4a68-981f-2439bfb85315" released by "delete_volume" :: held 0.947s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Created reservations ['48ed9ae4-f1f1-40b3-a290-55aae93f4d37', 'b8473b77-e7b1-47eb-9000-2f6ab77366f1', 'a8c460cd-811e-4768-9311-26d7f6019644', 'ee4acccf-7804-4804-b2b3-bfe0f2c465a7'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:14 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:14 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.info" returned: 0 in 0.333s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:14 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.info is being set with open permissions: ugo+rw Sep 23 00:33:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:14 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.info Sep 23 00:33:14 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:15 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.354s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:15 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:15 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Deleted volume successfully. Sep 23 00:33:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-e2dde2a9-743c-4d0f-85b1-773e6875cf9e tempest-ProjectReaderTests-1021144341 None] Lock "cinder-5f6d3953-8553-4a68-981f-2439bfb85315-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:15 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.info" returned: 0 in 0.354s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.723s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.627s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] Creating offline snapshot b493c57c-a6e1-4abb-96fb-bb618860f351 of volume a1131fbf-76eb-4f59-a101-b58031914dff {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:15 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-60df28a2-7571-4137-b7a6-497ab52919b7 tempest-CinderUnicodeTest-430341257 None] Create snapshot completed successfully Sep 23 00:33:15 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a6b938-00d3-45b1-a884-280445dbd818]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:15 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff Sep 23 00:33:15 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:15 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff" returned: 0 in 0.428s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:15 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 1G Sep 23 00:33:15 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Acquiring lock "cinder-97707646-ed63-43b5-b7c1-06e46ce63480-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Lock "cinder-97707646-ed63-43b5-b7c1-06e46ce63480-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Acquiring lock "cinder-quobyte-76d73c97-b2e3-4ef8-8259-46347e4bb1a3" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Lock "cinder-quobyte-76d73c97-b2e3-4ef8-8259-46347e4bb1a3" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Acquiring lock "cinder-quobyte-97707646-ed63-43b5-b7c1-06e46ce63480" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Lock "cinder-quobyte-97707646-ed63-43b5-b7c1-06e46ce63480" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Deleting offline snapshot 97707646-ed63-43b5-b7c1-06e46ce63480 of volume 76d73c97-b2e3-4ef8-8259-46347e4bb1a3 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] snapshot_file for this snap is: volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ff06f6-fed8-413e-803a-41d698e68c38]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:16 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 1G" returned: 0 in 0.713s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1131fbf-76eb-4f59-a101-b58031914dff -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:16 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1131fbf-76eb-4f59-a101-b58031914dff -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 Sep 23 00:33:16 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 Sep 23 00:33:16 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Flow 'volume_create_manager' (dbcc1439-4d84-40b0-ac25-28de8d20eed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee65b9bf-dfce-425a-8dc7-99031ce947ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee65b9bf-dfce-425a-8dc7-99031ce947ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937028953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ce117e-9bad-40cd-a695-dc25ef745bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b2dc3b9f7145a3ad3285542169a74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:17Z,use_quota=True,user_id='cc49c0a6d4e24be187ecdd3e940c22f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91492923-a709-47e8-8206-9da9f6e3af92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91492923-a709-47e8-8206-9da9f6e3af92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b727e81-99c2-4a1d-83d9-5d6eb7877e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b727e81-99c2-4a1d-83d9-5d6eb7877e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ce117e-9bad-40cd-a695-dc25ef745bfd', 'volume_name': 'volume-91ce117e-9bad-40cd-a695-dc25ef745bfd', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb9f45b-62fe-42cc-b202-87fd7a6b5479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb9f45b-62fe-42cc-b202-87fd7a6b5479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbd5002-335d-4bc0-9003-8b6ea018d845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:16 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Volume 91ce117e-9bad-40cd-a695-dc25ef745bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ce117e-9bad-40cd-a695-dc25ef745bfd', 'volume_size': 1} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:16 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1131fbf-76eb-4f59-a101-b58031914dff -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351" returned: 0 in 0.448s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:16 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 is being set with open permissions: ugo+rw Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:16 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 Sep 23 00:33:16 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480" returned: 0 in 0.587s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b521eb05-ad23-4dc8-81be-1548412c4f33]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351" returned: 0 in 0.312s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 Sep 23 00:33:17 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.info Sep 23 00:33:17 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:17 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.info" returned: 0 in 0.303s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.info is being set with open permissions: ugo+rw Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3" returned: 0 in 0.489s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.info Sep 23 00:33:17 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:17 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 Sep 23 00:33:17 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:17 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.info" returned: 0 in 0.299s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.620s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937028953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ce117e-9bad-40cd-a695-dc25ef745bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b2dc3b9f7145a3ad3285542169a74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:17Z,use_quota=True,user_id='cc49c0a6d4e24be187ecdd3e940c22f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Creating volume 91ce117e-9bad-40cd-a695-dc25ef745bfd {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:17 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd 1073741824 Sep 23 00:33:17 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-bcff6da9-7b0d-4d25-94ff-b882e0a633f8 tempest-ProjectMemberTests-1420876395 None] Create snapshot completed successfully Sep 23 00:33:17 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480" returned: 0 in 0.433s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480 Sep 23 00:33:17 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:18 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3.97707646-ed63-43b5-b7c1-06e46ce63480" returned: 0 in 0.313s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Lock "cinder-quobyte-97707646-ed63-43b5-b7c1-06e46ce63480" released by "_delete_snapshot" :: held 2.040s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Lock "cinder-quobyte-76d73c97-b2e3-4ef8-8259-46347e4bb1a3" released by "delete_snapshot" :: held 2.084s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Created reservations ['98acba34-b826-498e-a621-ede777930acd', '0f3dcd40-e553-4e26-84a1-8471d2d133c2', '06df5fa4-4893-44ee-9b9a-353c3cbc2744', '262ac5d1-3cef-449a-bd5e-ef6b8f3e5cd4'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:18 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd 1073741824" returned: 0 in 0.673s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:18 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Delete snapshot completed successfully. Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-63e84474-a646-4190-a2de-1df35e3c1d9c tempest-CinderUnicodeTest-430341257 None] Lock "cinder-97707646-ed63-43b5-b7c1-06e46ce63480-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:18 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd Sep 23 00:33:18 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-b493c57c-a6e1-4abb-96fb-bb618860f351-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Lock "cinder-b493c57c-a6e1-4abb-96fb-bb618860f351-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-a1131fbf-76eb-4f59-a101-b58031914dff" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-a1131fbf-76eb-4f59-a101-b58031914dff" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-b493c57c-a6e1-4abb-96fb-bb618860f351" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-b493c57c-a6e1-4abb-96fb-bb618860f351" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Deleting offline snapshot b493c57c-a6e1-4abb-96fb-bb618860f351 of volume a1131fbf-76eb-4f59-a101-b58031914dff {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] snapshot_file for this snap is: volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:18 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ccc42c-942d-474d-9f35-7758c8251eb8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd" returned: 0 in 0.413s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbd5002-335d-4bc0-9003-8b6ea018d845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ce117e-9bad-40cd-a695-dc25ef745bfd', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21911304-038c-467b-a776-40b81507814c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:18 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Volume volume-91ce117e-9bad-40cd-a695-dc25ef745bfd (91ce117e-9bad-40cd-a695-dc25ef745bfd): created successfully Sep 23 00:33:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21911304-038c-467b-a776-40b81507814c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Flow 'volume_create_manager' (dbcc1439-4d84-40b0-ac25-28de8d20eed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:19 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f500a9e0-ebb4-44ad-879e-4b75f695f19b tempest-ProjectReaderTests-1021144341 None] Created volume successfully. Sep 23 00:33:19 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 Sep 23 00:33:19 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Acquiring lock "cinder-76d73c97-b2e3-4ef8-8259-46347e4bb1a3-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:19 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351" returned: 0 in 0.506s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1131fbf-76eb-4f59-a101-b58031914dff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Lock "cinder-76d73c97-b2e3-4ef8-8259-46347e4bb1a3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:19 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3839e67-9f01-44cf-8fd9-f59ba349d803]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Acquiring lock "cinder-quobyte-76d73c97-b2e3-4ef8-8259-46347e4bb1a3" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Lock "cinder-quobyte-76d73c97-b2e3-4ef8-8259-46347e4bb1a3" acquired by "delete_volume" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:19 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf2e63f-def7-4679-bede-56efdd7930ae]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:19 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff Sep 23 00:33:19 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:19 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 Sep 23 00:33:19 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] Creating offline snapshot a44f0afc-2129-40b9-ad65-7b49f7b274ae of volume 91ce117e-9bad-40cd-a695-dc25ef745bfd {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:20 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff" returned: 0 in 0.580s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad22ed0-b988-4c03-8b3d-af29c64ff457]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:20 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 Sep 23 00:33:20 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:20 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd Sep 23 00:33:20 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:20 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3" returned: 0 in 0.768s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:20 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3 Sep 23 00:33:20 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:20 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351" returned: 0 in 0.556s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:20 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351 Sep 23 00:33:20 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:20 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-76d73c97-b2e3-4ef8-8259-46347e4bb1a3" returned: 0 in 0.433s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:20 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Lock "cinder-quobyte-76d73c97-b2e3-4ef8-8259-46347e4bb1a3" released by "delete_volume" :: held 1.303s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd" returned: 0 in 0.752s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:20 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae 1G Sep 23 00:33:20 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:20 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Created reservations ['3f7d15c4-65d3-4b9c-87fd-d8beab0d6f5a', 'ad8257b0-1a9b-4bcd-a7bd-74675fae8d91', 'cecf5c50-1292-49bc-8bbd-028c5571ed43', '58245ab4-b1cc-4b8e-a99e-9396fc18863c'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:21 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff.b493c57c-a6e1-4abb-96fb-bb618860f351" returned: 0 in 0.416s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-b493c57c-a6e1-4abb-96fb-bb618860f351" released by "_delete_snapshot" :: held 2.236s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-a1131fbf-76eb-4f59-a101-b58031914dff" released by "delete_snapshot" :: held 2.273s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:21 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:21 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Created reservations ['7067b066-8743-4c83-8288-5a2a645c4705', '26d610f9-1564-4367-95dc-884808f55c14', '5edf9cc4-4afb-4f85-8161-51d4bee2b799', '6302df8f-b026-4b9a-b76e-5184d8f1d3fb'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:21 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Delete snapshot completed successfully. Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97d67c14-a9cb-40c6-b0cd-eabf8c02f51e tempest-ProjectMemberTests-1420876395 None] Lock "cinder-b493c57c-a6e1-4abb-96fb-bb618860f351-delete_snapshot" released by "delete_snapshot" :: held 2.555s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:21 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.377s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:21 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Deleted volume successfully. Sep 23 00:33:21 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-55f68f55-bf86-4e71-afb4-8f076f83db65 tempest-CinderUnicodeTest-430341257 None] Lock "cinder-76d73c97-b2e3-4ef8-8259-46347e4bb1a3-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae 1G" returned: 0 in 0.719s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ce117e-9bad-40cd-a695-dc25ef745bfd -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:21 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ce117e-9bad-40cd-a695-dc25ef745bfd -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae Sep 23 00:33:21 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Acquiring lock "cinder-e0dc8654-ce6e-4326-be19-d7433a9cd746-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Lock "cinder-e0dc8654-ce6e-4326-be19-d7433a9cd746-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Acquiring lock "cinder-quobyte-e0dc8654-ce6e-4326-be19-d7433a9cd746" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Lock "cinder-quobyte-e0dc8654-ce6e-4326-be19-d7433a9cd746" acquired by "delete_volume" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:21 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ce117e-9bad-40cd-a695-dc25ef745bfd -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae" returned: 0 in 0.424s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:21 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae is being set with open permissions: ugo+rw Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a309c4d2-e3c1-44ce-8f44-e31ac863adf5]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e0dc8654-ce6e-4326-be19-d7433a9cd746 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:22 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae Sep 23 00:33:22 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:22 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e0dc8654-ce6e-4326-be19-d7433a9cd746 Sep 23 00:33:22 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-a1131fbf-76eb-4f59-a101-b58031914dff-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Lock "cinder-a1131fbf-76eb-4f59-a101-b58031914dff-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-a1131fbf-76eb-4f59-a101-b58031914dff" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-a1131fbf-76eb-4f59-a101-b58031914dff" acquired by "delete_volume" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd52e6e-ebd0-403d-a6d9-fb45034e008d]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:22 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae" returned: 0 in 0.378s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:22 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.info Sep 23 00:33:22 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:22 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff Sep 23 00:33:22 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:22 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e0dc8654-ce6e-4326-be19-d7433a9cd746" returned: 0 in 0.532s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e0dc8654-ce6e-4326-be19-d7433a9cd746 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:22 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e0dc8654-ce6e-4326-be19-d7433a9cd746 Sep 23 00:33:22 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:22 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.info" returned: 0 in 0.318s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:22 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.info is being set with open permissions: ugo+rw Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:22 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.info Sep 23 00:33:22 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:22 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff" returned: 0 in 0.461s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:22 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff Sep 23 00:33:22 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:22 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e0dc8654-ce6e-4326-be19-d7433a9cd746" returned: 0 in 0.320s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Lock "cinder-quobyte-e0dc8654-ce6e-4326-be19-d7433a9cd746" released by "delete_volume" :: held 0.943s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Created reservations ['237c8788-274d-469c-9971-3ee078b05888', 'a2062a7f-8f0f-4cb5-bafc-5340c4248578', '72ba3f36-3dbb-4c23-8701-b30c7874eac8', '3ffe9c0a-ad3f-451c-9377-9809b8626791'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:23 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.info" returned: 0 in 0.343s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.062s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b1a517b4-c80f-4110-9990-a963c7f8e767 tempest-ProjectReaderTests-1021144341 None] Create snapshot completed successfully Sep 23 00:33:23 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-a1131fbf-76eb-4f59-a101-b58031914dff" returned: 0 in 0.416s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-a1131fbf-76eb-4f59-a101-b58031914dff" released by "delete_volume" :: held 0.977s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:23 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:23 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Created reservations ['1fa8ff1a-8924-451a-862a-00e29098acae', 'd3a49ed6-7474-4ce6-a002-2dc35fab3707', '13cbf2e6-2848-4f09-bba5-34ea00eb0c2b', '2436fc91-53de-448c-89e5-12b485a1d5d6'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:23 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:23 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:23 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.308s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Deleted volume successfully. Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b3a0baeb-bd88-4e58-960b-22fa4d927705 tempest-CinderUnicodeTest-430341257 None] Lock "cinder-e0dc8654-ce6e-4326-be19-d7433a9cd746-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:23 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.348s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:23 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Deleted volume successfully. Sep 23 00:33:23 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-97cd177b-f34f-4705-b41d-f5ce0ce0cdea tempest-ProjectMemberTests-1420876395 None] Lock "cinder-a1131fbf-76eb-4f59-a101-b58031914dff-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (fffe939b-c099-42f2-88f5-180354a0415c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c13315-b083-4179-a6e4-6014e7e66541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c13315-b083-4179-a6e4-6014e7e66541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2043246331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe2f40b-1d28-4396-b49a-560287e87001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:24Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a927ed25-4bdb-4a3f-9788-dc77374aa6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a927ed25-4bdb-4a3f-9788-dc77374aa6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c8b458-6514-4dfe-b9c0-6f51683e151e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c8b458-6514-4dfe-b9c0-6f51683e151e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe2f40b-1d28-4396-b49a-560287e87001', 'volume_name': 'volume-9fe2f40b-1d28-4396-b49a-560287e87001', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1659d893-942a-45f3-b0a1-22056e6b8ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1659d893-942a-45f3-b0a1-22056e6b8ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463de1d9-1de7-459c-a380-c764ffe4a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:24 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Volume 9fe2f40b-1d28-4396-b49a-560287e87001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe2f40b-1d28-4396-b49a-560287e87001', 'volume_size': 1} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2043246331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe2f40b-1d28-4396-b49a-560287e87001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:24Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Creating volume 9fe2f40b-1d28-4396-b49a-560287e87001 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:24 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:24 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 1073741824 Sep 23 00:33:24 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-a44f0afc-2129-40b9-ad65-7b49f7b274ae-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-a44f0afc-2129-40b9-ad65-7b49f7b274ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-91ce117e-9bad-40cd-a695-dc25ef745bfd" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-91ce117e-9bad-40cd-a695-dc25ef745bfd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-a44f0afc-2129-40b9-ad65-7b49f7b274ae" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-a44f0afc-2129-40b9-ad65-7b49f7b274ae" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Deleting offline snapshot a44f0afc-2129-40b9-ad65-7b49f7b274ae of volume 91ce117e-9bad-40cd-a695-dc25ef745bfd {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] snapshot_file for this snap is: volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd34fdf-668c-41b1-b229-dc4ad25b6c84]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:24 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae Sep 23 00:33:24 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:24 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 1073741824" returned: 0 in 0.707s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:25 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 Sep 23 00:33:25 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:25 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae" returned: 0 in 0.685s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ce117e-9bad-40cd-a695-dc25ef745bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[84622b4e-47d8-4ce6-b881-1f9e4ef1a252]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:25 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001" returned: 0 in 0.372s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:25 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd Sep 23 00:33:25 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463de1d9-1de7-459c-a380-c764ffe4a459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe2f40b-1d28-4396-b49a-560287e87001', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30986caf-c28f-4983-bd6c-24206eaf3856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:25 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Volume volume-9fe2f40b-1d28-4396-b49a-560287e87001 (9fe2f40b-1d28-4396-b49a-560287e87001): created successfully Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30986caf-c28f-4983-bd6c-24206eaf3856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (fffe939b-c099-42f2-88f5-180354a0415c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:25 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-84b0b7f8-d9b9-4929-9f08-9eb2c38814ee tempest-ProjectMemberTests-1420876395 None] Created volume successfully. Sep 23 00:33:25 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd" returned: 0 in 0.558s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:25 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae Sep 23 00:33:25 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:26 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae" returned: 0 in 0.551s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:26 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae Sep 23 00:33:26 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] Creating offline snapshot bd8cad80-3ceb-4a1c-b5b1-98bc98146653 of volume 9fe2f40b-1d28-4396-b49a-560287e87001 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:26 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2591e74-2ee5-4dc1-a862-534e848fa7ba]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:26 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd.a44f0afc-2129-40b9-ad65-7b49f7b274ae" returned: 0 in 0.408s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-a44f0afc-2129-40b9-ad65-7b49f7b274ae" released by "_delete_snapshot" :: held 2.379s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-91ce117e-9bad-40cd-a695-dc25ef745bfd" released by "delete_snapshot" :: held 2.420s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:26 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 Sep 23 00:33:26 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:26 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Created reservations ['9527a665-c6f7-461e-9975-2ff076155e84', 'd72b9ddd-fdbf-461a-bea6-1baea5d62b33', 'a838444d-fa6d-4c59-a5b5-977b17bbe741', 'cb288a7a-d265-4771-bb67-0f47d130e35e'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:27 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Delete snapshot completed successfully. Sep 23 00:33:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2c8f30a4-5a63-4374-ac19-a9f6e6627d49 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-a44f0afc-2129-40b9-ad65-7b49f7b274ae-delete_snapshot" released by "delete_snapshot" :: held 2.711s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:27 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001" returned: 0 in 0.554s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:27 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 1G Sep 23 00:33:27 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-91ce117e-9bad-40cd-a695-dc25ef745bfd-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-91ce117e-9bad-40cd-a695-dc25ef745bfd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "cinder-quobyte-91ce117e-9bad-40cd-a695-dc25ef745bfd" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-91ce117e-9bad-40cd-a695-dc25ef745bfd" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:27 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e183323a-6bd6-43eb-a1fd-227b06133f54]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:27 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 1G" returned: 0 in 0.634s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe2f40b-1d28-4396-b49a-560287e87001 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:27 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe2f40b-1d28-4396-b49a-560287e87001 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 Sep 23 00:33:27 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:28 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd Sep 23 00:33:28 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:28 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe2f40b-1d28-4396-b49a-560287e87001 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653" returned: 0 in 0.429s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:28 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 is being set with open permissions: ugo+rw Sep 23 00:33:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:28 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 Sep 23 00:33:28 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:28 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd" returned: 0 in 0.600s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:28 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd Sep 23 00:33:28 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:28 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653" returned: 0 in 0.497s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:28 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.info Sep 23 00:33:28 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:28 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-91ce117e-9bad-40cd-a695-dc25ef745bfd" returned: 0 in 0.536s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-quobyte-91ce117e-9bad-40cd-a695-dc25ef745bfd" released by "delete_volume" :: held 1.242s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Created reservations ['45dfaa9d-3d24-40b1-ae4a-ffb7313047ca', '47b1172b-a549-4860-b275-e32c2784c8ae', 'c47385ac-e3b7-4eab-94a4-a32ccbbb12e1', '25f3f9af-e30b-46d4-89e2-f3827e5bdd5f'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:29 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:29 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:29 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.info" returned: 0 in 0.489s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:29 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.info is being set with open permissions: ugo+rw Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:29 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.info Sep 23 00:33:29 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:29 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.356s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:29 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:29 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Deleted volume successfully. Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.info" returned: 0 in 0.323s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.077s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:29 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-24ccd8a5-3d5d-47cd-b42a-398076406441 tempest-ProjectMemberTests-1420876395 None] Create snapshot completed successfully Sep 23 00:33:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-64c4ff7e-ade1-42ca-b349-af64abcf1967 tempest-ProjectReaderTests-1021144341 None] Lock "cinder-91ce117e-9bad-40cd-a695-dc25ef745bfd-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-bd8cad80-3ceb-4a1c-b5b1-98bc98146653-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Lock "cinder-bd8cad80-3ceb-4a1c-b5b1-98bc98146653-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-9fe2f40b-1d28-4396-b49a-560287e87001" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-9fe2f40b-1d28-4396-b49a-560287e87001" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-bd8cad80-3ceb-4a1c-b5b1-98bc98146653" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:30 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-bd8cad80-3ceb-4a1c-b5b1-98bc98146653" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Deleting offline snapshot bd8cad80-3ceb-4a1c-b5b1-98bc98146653 of volume 9fe2f40b-1d28-4396-b49a-560287e87001 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] snapshot_file for this snap is: volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:31 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a7ade2-b6a4-429b-8204-7e22ad56d138]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:31 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 Sep 23 00:33:31 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:31 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653" returned: 0 in 0.640s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fe2f40b-1d28-4396-b49a-560287e87001(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:31 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9e5e2b-5d75-4fa6-bcea-550fa6f874e7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:31 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 Sep 23 00:33:31 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:32 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001" returned: 0 in 0.604s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 Sep 23 00:33:32 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:32 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653" returned: 0 in 0.594s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:32 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653 Sep 23 00:33:32 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:33 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001.bd8cad80-3ceb-4a1c-b5b1-98bc98146653" returned: 0 in 0.391s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-bd8cad80-3ceb-4a1c-b5b1-98bc98146653" released by "_delete_snapshot" :: held 2.404s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-9fe2f40b-1d28-4396-b49a-560287e87001" released by "delete_snapshot" :: held 2.449s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:33 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Created reservations ['71f235fb-b960-4f43-a914-fdf5113c7030', '0eb35a05-4766-4894-b638-0243e6450265', 'afda7a17-3375-4f8a-812a-7f1fb80cf45e', '21e7f606-6bc3-48c6-bef1-10fbfd1980b4'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:33 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Delete snapshot completed successfully. Sep 23 00:33:33 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4c0641c2-d83d-4299-93c8-c4b3c8a4098f tempest-ProjectMemberTests-1420876395 None] Lock "cinder-bd8cad80-3ceb-4a1c-b5b1-98bc98146653-delete_snapshot" released by "delete_snapshot" :: held 2.744s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-9fe2f40b-1d28-4396-b49a-560287e87001-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Lock "cinder-9fe2f40b-1d28-4396-b49a-560287e87001-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-9fe2f40b-1d28-4396-b49a-560287e87001" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:34 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-9fe2f40b-1d28-4396-b49a-560287e87001" acquired by "delete_volume" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:34 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2df0e78-abe9-4655-a115-05a4559395cd]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:34 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 Sep 23 00:33:34 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:35 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001" returned: 0 in 0.694s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:35 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001 Sep 23 00:33:35 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:35 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9fe2f40b-1d28-4396-b49a-560287e87001" returned: 0 in 0.421s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-9fe2f40b-1d28-4396-b49a-560287e87001" released by "delete_volume" :: held 1.248s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:35 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Created reservations ['35916a1f-b66a-4238-81b1-6ee9d0724cf4', 'fd6d42eb-d8d4-4735-b216-6f7e5a751b75', 'c8722274-b976-4a8a-9c24-1877ad8e27c0', 'a36d34a4-1552-4b08-98d3-2a2ea418481f'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:35 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:35 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:36 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.341s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:36 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Deleted volume successfully. Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-06621a57-8109-417d-a02e-23f37bc82efe tempest-ProjectMemberTests-1420876395 None] Lock "cinder-9fe2f40b-1d28-4396-b49a-560287e87001-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Flow 'volume_create_manager' (125f709b-e5fa-410f-a9c6-fdc0ffed1bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa8379c-1e07-414e-8a5d-2edaa30af886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa8379c-1e07-414e-8a5d-2edaa30af886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317020926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d020d72-55da-4a3c-8098-a6f67679890c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c59015553a4c71b361a570f35e0da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:37Z,use_quota=True,user_id='7a859a7c10204a72a703ff81fde59e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80912337-511d-40ca-a3a5-71fd4645e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80912337-511d-40ca-a3a5-71fd4645e827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69140ed8-3c46-494b-a032-036ede06021a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69140ed8-3c46-494b-a032-036ede06021a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d020d72-55da-4a3c-8098-a6f67679890c', 'volume_name': 'volume-6d020d72-55da-4a3c-8098-a6f67679890c', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2779de6a-4e3d-4dfe-953e-b550e16c7239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2779de6a-4e3d-4dfe-953e-b550e16c7239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ba80e1-d2e5-4f8f-960f-30ebba9a4a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:36 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Volume 6d020d72-55da-4a3c-8098-a6f67679890c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d020d72-55da-4a3c-8098-a6f67679890c', 'volume_size': 1} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317020926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d020d72-55da-4a3c-8098-a6f67679890c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c59015553a4c71b361a570f35e0da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:37Z,use_quota=True,user_id='7a859a7c10204a72a703ff81fde59e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Creating volume 6d020d72-55da-4a3c-8098-a6f67679890c {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:36 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:33:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6d020d72-55da-4a3c-8098-a6f67679890c 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:36 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6d020d72-55da-4a3c-8098-a6f67679890c 1073741824 Sep 23 00:33:36 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (5bfab4d6-bef0-453d-93ca-669da7234624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8bbb69-8e83-465a-b127-718d221a1032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8bbb69-8e83-465a-b127-718d221a1032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660592096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d4b614-7c4f-429e-878c-6cc8baa6bd42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:37Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9359fa-c619-47c5-982d-0b9900654718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9359fa-c619-47c5-982d-0b9900654718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a1beb6-2ec2-41a1-924c-9d40b3a7e51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a1beb6-2ec2-41a1-924c-9d40b3a7e51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d4b614-7c4f-429e-878c-6cc8baa6bd42', 'volume_name': 'volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5512e27-19c2-490c-ab69-0bee9fbce37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5512e27-19c2-490c-ab69-0bee9fbce37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222ca6d3-713d-431d-aa3a-64a7f5372657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:37 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Volume 75d4b614-7c4f-429e-878c-6cc8baa6bd42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42', 'volume_size': 1} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:37 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6d020d72-55da-4a3c-8098-a6f67679890c 1073741824" returned: 0 in 0.669s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6d020d72-55da-4a3c-8098-a6f67679890c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:37 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6d020d72-55da-4a3c-8098-a6f67679890c Sep 23 00:33:37 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:37 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6d020d72-55da-4a3c-8098-a6f67679890c" returned: 0 in 0.313s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660592096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d4b614-7c4f-429e-878c-6cc8baa6bd42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:37Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Creating volume 75d4b614-7c4f-429e-878c-6cc8baa6bd42 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:37 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:38 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:33:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ba80e1-d2e5-4f8f-960f-30ebba9a4a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d020d72-55da-4a3c-8098-a6f67679890c', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9db2120-3b4b-4b01-b2aa-a7011047b431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:38 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 1073741824 Sep 23 00:33:38 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:38 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Volume volume-6d020d72-55da-4a3c-8098-a6f67679890c (6d020d72-55da-4a3c-8098-a6f67679890c): created successfully Sep 23 00:33:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9db2120-3b4b-4b01-b2aa-a7011047b431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:38 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Flow 'volume_create_manager' (125f709b-e5fa-410f-a9c6-fdc0ffed1bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:38 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-05823a85-75a5-42ab-af8f-fc1bd599a9e2 tempest-ProjectReaderTests-1827694622 None] Created volume successfully. Sep 23 00:33:38 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 1073741824" returned: 0 in 0.727s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:38 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 Sep 23 00:33:38 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:39 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42" returned: 0 in 0.429s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222ca6d3-713d-431d-aa3a-64a7f5372657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7daff6f0-33e4-4c70-9d67-7140459eb04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:39 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Volume volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 (75d4b614-7c4f-429e-878c-6cc8baa6bd42): created successfully Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7daff6f0-33e4-4c70-9d67-7140459eb04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (5bfab4d6-bef0-453d-93ca-669da7234624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Acquiring lock "cinder-6d020d72-55da-4a3c-8098-a6f67679890c-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:39 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7ac56536-e432-4dfb-8f79-58f8c40bb439 tempest-ProjectMemberTests-1420876395 None] Created volume successfully. Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Lock "cinder-6d020d72-55da-4a3c-8098-a6f67679890c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Acquiring lock "cinder-quobyte-6d020d72-55da-4a3c-8098-a6f67679890c" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Lock "cinder-quobyte-6d020d72-55da-4a3c-8098-a6f67679890c" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e5cd50-7bb1-4bf1-936d-4dfcbc7987a9]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6d020d72-55da-4a3c-8098-a6f67679890c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:39 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6d020d72-55da-4a3c-8098-a6f67679890c Sep 23 00:33:39 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] Creating offline snapshot ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 of volume 75d4b614-7c4f-429e-878c-6cc8baa6bd42 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec888d3-b0a7-4680-b019-37e80affc3d1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:40 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6d020d72-55da-4a3c-8098-a6f67679890c" returned: 0 in 0.593s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6d020d72-55da-4a3c-8098-a6f67679890c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:40 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 Sep 23 00:33:40 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:40 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6d020d72-55da-4a3c-8098-a6f67679890c Sep 23 00:33:40 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:40 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-6d020d72-55da-4a3c-8098-a6f67679890c" returned: 0 in 0.401s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Lock "cinder-quobyte-6d020d72-55da-4a3c-8098-a6f67679890c" released by "delete_volume" :: held 1.079s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:40 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42" returned: 0 in 0.734s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Created reservations ['27e2d949-36d0-448c-ad14-d1882813760e', 'da39a78f-ea19-447a-97ef-7af275db3655', '4cfbfb5a-d3b3-49aa-8daf-15bcc76f0727', '4c64ca0c-75df-4dff-92c2-2e5e04276a8d'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:40 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 1G Sep 23 00:33:40 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:40 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:40 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:41 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.358s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:41 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:41 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Deleted volume successfully. Sep 23 00:33:41 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9da0f580-9678-41f5-a329-940e84cdfee4 tempest-ProjectReaderTests-1827694622 None] Lock "cinder-6d020d72-55da-4a3c-8098-a6f67679890c-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:41 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 1G" returned: 0 in 0.651s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:41 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 Sep 23 00:33:41 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:41 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289" returned: 0 in 0.415s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:41 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 is being set with open permissions: ugo+rw Sep 23 00:33:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:41 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 Sep 23 00:33:41 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289" returned: 0 in 0.332s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.info Sep 23 00:33:42 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.info" returned: 0 in 0.381s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.info is being set with open permissions: ugo+rw Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.info Sep 23 00:33:42 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Flow 'volume_create_manager' (26a1ab89-c178-4882-8155-65c1dd2e5962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d1aff7-9b91-4075-bc0b-b61145fe4e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d1aff7-9b91-4075-bc0b-b61145fe4e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1537802841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa5b20f-de7d-4373-93b7-708ddc6a4b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c59015553a4c71b361a570f35e0da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:43Z,use_quota=True,user_id='7a859a7c10204a72a703ff81fde59e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221ebcdf-b5e5-40bd-80c9-5525b2e2115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221ebcdf-b5e5-40bd-80c9-5525b2e2115b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a84ce55-aeb9-4703-a995-f4b41879d8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a84ce55-aeb9-4703-a995-f4b41879d8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa5b20f-de7d-4373-93b7-708ddc6a4b36', 'volume_name': 'volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688ee880-7be8-4532-9bca-64f88278f8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688ee880-7be8-4532-9bca-64f88278f8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5337d9d3-6fd7-4b19-8be0-b1a4cd76e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:42 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Volume caa5b20f-de7d-4373-93b7-708ddc6a4b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36', 'volume_size': 1} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:42 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.info" returned: 0 in 0.343s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.013s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.196s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1537802841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa5b20f-de7d-4373-93b7-708ddc6a4b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c59015553a4c71b361a570f35e0da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:43Z,use_quota=True,user_id='7a859a7c10204a72a703ff81fde59e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Creating volume caa5b20f-de7d-4373-93b7-708ddc6a4b36 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:42 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:33:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:42 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36 1073741824 Sep 23 00:33:42 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:42 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-8d8092ec-ed75-4f81-a91e-096e506e8597 tempest-ProjectMemberTests-1420876395 None] Create snapshot completed successfully Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Lock "cinder-ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-75d4b614-7c4f-429e-878c-6cc8baa6bd42" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-75d4b614-7c4f-429e-878c-6cc8baa6bd42" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Deleting offline snapshot ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 of volume 75d4b614-7c4f-429e-878c-6cc8baa6bd42 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] snapshot_file for this snap is: volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70d9d70-3596-4e58-a561-68db5adfaed2]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:43 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 Sep 23 00:33:43 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:43 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36 1073741824" returned: 0 in 0.695s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:43 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36 Sep 23 00:33:43 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:43 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289" returned: 0 in 0.551s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[28de63be-110e-4a66-8167-c605e14647e0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:44 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 Sep 23 00:33:44 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:44 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36" returned: 0 in 0.405s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5337d9d3-6fd7-4b19-8be0-b1a4cd76e844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a864447d-f4af-4bb3-97b8-e4c32f6583a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:44 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Volume volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36 (caa5b20f-de7d-4373-93b7-708ddc6a4b36): created successfully Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a864447d-f4af-4bb3-97b8-e4c32f6583a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Flow 'volume_create_manager' (26a1ab89-c178-4882-8155-65c1dd2e5962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:44 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2aa6afcd-396d-4f80-930a-5210686b647f tempest-ProjectReaderTests-1827694622 None] Created volume successfully. Sep 23 00:33:44 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42" returned: 0 in 0.449s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:44 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 Sep 23 00:33:44 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Acquiring lock "cinder-caa5b20f-de7d-4373-93b7-708ddc6a4b36-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Lock "cinder-caa5b20f-de7d-4373-93b7-708ddc6a4b36-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Acquiring lock "cinder-quobyte-caa5b20f-de7d-4373-93b7-708ddc6a4b36" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Lock "cinder-quobyte-caa5b20f-de7d-4373-93b7-708ddc6a4b36" acquired by "delete_volume" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb762ca-c591-4b64-8e28-471617ef1b5c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:44 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289" returned: 0 in 0.468s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:44 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289 Sep 23 00:33:44 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:44 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36 Sep 23 00:33:44 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:45 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:45 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:45 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42.ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289" returned: 0 in 0.338s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289" released by "_delete_snapshot" :: held 2.004s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-75d4b614-7c4f-429e-878c-6cc8baa6bd42" released by "delete_snapshot" :: held 2.039s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:45 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36" returned: 0 in 0.484s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:45 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36 Sep 23 00:33:45 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Created reservations ['e72e9622-caa7-49c0-a7a3-c6e9ed43da29', '1aabe063-8338-4500-a8b1-561f3c16fb7a', '1f64fe73-e261-4b25-8434-1eb55bcd26eb', '0942765f-33e7-4df3-916b-a22ef29265a5'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:45 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.411s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:33:45 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Delete snapshot completed successfully. Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-bc276963-d93d-401d-8ecf-473037e8413d tempest-ProjectMemberTests-1420876395 None] Lock "cinder-ac9aafd1-cb44-4fe8-9d3a-f75bc4a4a289-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:45 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-caa5b20f-de7d-4373-93b7-708ddc6a4b36" returned: 0 in 0.385s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Lock "cinder-quobyte-caa5b20f-de7d-4373-93b7-708ddc6a4b36" released by "delete_volume" :: held 0.930s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Created reservations ['8e1dc2d8-d691-4d7f-bde2-49f32e6456c7', 'e964b941-5411-4fa0-9927-8c45181ed0d1', '55f1c5f7-c94c-4853-b803-60e5f67d87c4', '07470fa5-839a-49e3-b984-108b901a9a24'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:45 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:45 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:46 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.387s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:46 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:46 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Deleted volume successfully. Sep 23 00:33:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6e3b3d08-c1a4-4ef3-864e-a72f0e98bbe3 tempest-ProjectReaderTests-1827694622 None] Lock "cinder-caa5b20f-de7d-4373-93b7-708ddc6a4b36-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-75d4b614-7c4f-429e-878c-6cc8baa6bd42-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-75d4b614-7c4f-429e-878c-6cc8baa6bd42-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-75d4b614-7c4f-429e-878c-6cc8baa6bd42" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:46 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-75d4b614-7c4f-429e-878c-6cc8baa6bd42" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:46 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43088c4-b0c9-48db-a844-84a2a7bca29b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:46 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 Sep 23 00:33:46 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:47 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42" returned: 0 in 0.500s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:47 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42 Sep 23 00:33:47 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:47 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-75d4b614-7c4f-429e-878c-6cc8baa6bd42" returned: 0 in 0.322s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-75d4b614-7c4f-429e-878c-6cc8baa6bd42" released by "delete_volume" :: held 0.924s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:47 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Created reservations ['12cdb5fd-2081-467a-ad8c-d11a10a163fc', 'b5574922-bb87-41c4-9105-49fae2eba148', 'e9792be9-d9c9-42fc-a6f9-4bbb49ac14ea', 'de7fba79-b32b-4e57-b205-9d85eda2aadf'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:47 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:47 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:47 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.364s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:48 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Deleted volume successfully. Sep 23 00:33:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ca2f1857-86db-4251-b069-e721b0af7d2c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-75d4b614-7c4f-429e-878c-6cc8baa6bd42-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (16bd14b1-6c47-4758-9ce1-e80f4340de24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b2e12e-4138-4d45-b419-89a2b34cb51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b2e12e-4138-4d45-b419-89a2b34cb51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1194220562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449f7a86-f72a-4bb8-9c3e-ca3107e69a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:49Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e56567-76b1-4b3f-8aa2-86ea29f43077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e56567-76b1-4b3f-8aa2-86ea29f43077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12ab60d-7c52-45c9-b6ad-f326b2de0811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12ab60d-7c52-45c9-b6ad-f326b2de0811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449f7a86-f72a-4bb8-9c3e-ca3107e69a32', 'volume_name': 'volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ce9423-446e-4bff-8659-94aaa17b1bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ce9423-446e-4bff-8659-94aaa17b1bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bdaf63-c270-47db-a4a6-bad0247bcffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:49 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Volume 449f7a86-f72a-4bb8-9c3e-ca3107e69a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32', 'volume_size': 1} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1194220562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449f7a86-f72a-4bb8-9c3e-ca3107e69a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:49Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Creating volume 449f7a86-f72a-4bb8-9c3e-ca3107e69a32 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:49 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:33:49 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:49 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 1073741824 Sep 23 00:33:49 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:50 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 1073741824" returned: 0 in 0.799s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:50 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 Sep 23 00:33:50 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:50 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32" returned: 0 in 0.386s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:50 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:50 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bdaf63-c270-47db-a4a6-bad0247bcffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e6fb6d-089a-46c5-b753-58fd631b091a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:51 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Volume volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 (449f7a86-f72a-4bb8-9c3e-ca3107e69a32): created successfully Sep 23 00:33:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e6fb6d-089a-46c5-b753-58fd631b091a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:51 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (16bd14b1-6c47-4758-9ce1-e80f4340de24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:51 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-40f3cf4f-507b-412b-8d34-27268dd4482c tempest-ProjectMemberTests-1420876395 None] Created volume successfully. Sep 23 00:33:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:51 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] Creating offline snapshot 1ee8f170-7253-44ed-aa87-aec341993e6e of volume 449f7a86-f72a-4bb8-9c3e-ca3107e69a32 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:51 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a1e7a7-94d0-41ff-9051-e4b9b2699031]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:51 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:52 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 Sep 23 00:33:52 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:52 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32" returned: 0 in 0.520s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:52 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:52 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e 1G Sep 23 00:33:52 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e 1G" returned: 0 in 0.718s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:53 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e Sep 23 00:33:53 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Flow 'volume_create_manager' (00657b15-f203-4114-b843-5e6d9f121d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a3dca0-f399-491a-9d84-374258dafd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a3dca0-f399-491a-9d84-374258dafd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-326353630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ad5bfc-7da7-4116-9eca-f66149f82dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427a0cb275b44ff6b9ef25cb6adc13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:53Z,use_quota=True,user_id='defa54c83fb7449cbd58a1eff4774ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342a35f4-ce3a-4a54-bd39-b17fc4dfb841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342a35f4-ce3a-4a54-bd39-b17fc4dfb841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30941083-f275-4fc0-ada2-abff62a91404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30941083-f275-4fc0-ada2-abff62a91404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ad5bfc-7da7-4116-9eca-f66149f82dd1', 'volume_name': 'volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bbb4eaf-a7b6-4a04-a02b-e5248c7d3168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bbb4eaf-a7b6-4a04-a02b-e5248c7d3168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0d5ec7-4490-43f9-950a-d7388d9428ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:53 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Volume 97ad5bfc-7da7-4116-9eca-f66149f82dd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1', 'volume_size': 1} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:53 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e" returned: 0 in 0.459s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e is being set with open permissions: ugo+rw Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:53 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e Sep 23 00:33:53 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:53 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e" returned: 0 in 0.283s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:53 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:54 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.info Sep 23 00:33:54 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:54 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.info" returned: 0 in 0.285s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:54 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.info is being set with open permissions: ugo+rw Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:54 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.info Sep 23 00:33:54 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:54 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.info" returned: 0 in 0.406s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.810s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.103s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-326353630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ad5bfc-7da7-4116-9eca-f66149f82dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427a0cb275b44ff6b9ef25cb6adc13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:53Z,use_quota=True,user_id='defa54c83fb7449cbd58a1eff4774ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Creating volume 97ad5bfc-7da7-4116-9eca-f66149f82dd1 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:54 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:54 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1 1073741824 Sep 23 00:33:54 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:54 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ee21ceac-e8ee-4c6f-8d6d-96725e9d06a0 tempest-ProjectMemberTests-1420876395 None] Create snapshot completed successfully Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Flow 'volume_create_manager' (192149b0-392e-4ad7-8974-dab38c0c965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8d70a0-4371-4eea-a529-97cd557143d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8d70a0-4371-4eea-a529-97cd557143d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1418610022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c40edf-e8b8-4b79-b588-97d63fc49d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e4c65666924c0db5ca0f41da68c21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:55Z,use_quota=True,user_id='3afa771112314ece83e0bda3e7365d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e97625a-b6db-4e3f-8ebc-311c5aa846e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e97625a-b6db-4e3f-8ebc-311c5aa846e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c17cc8-fecd-4dcc-a7fb-053984b61983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c17cc8-fecd-4dcc-a7fb-053984b61983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c40edf-e8b8-4b79-b588-97d63fc49d1b', 'volume_name': 'volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f85650-98d0-4a87-9739-2540f1d8e0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f85650-98d0-4a87-9739-2540f1d8e0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c6b7a7-8948-4935-ba91-0bcc0167fb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:54 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Volume e6c40edf-e8b8-4b79-b588-97d63fc49d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b', 'volume_size': 1} Sep 23 00:33:54 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-1ee8f170-7253-44ed-aa87-aec341993e6e-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Lock "cinder-1ee8f170-7253-44ed-aa87-aec341993e6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-449f7a86-f72a-4bb8-9c3e-ca3107e69a32" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-449f7a86-f72a-4bb8-9c3e-ca3107e69a32" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-1ee8f170-7253-44ed-aa87-aec341993e6e" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-1ee8f170-7253-44ed-aa87-aec341993e6e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Deleting offline snapshot 1ee8f170-7253-44ed-aa87-aec341993e6e of volume 449f7a86-f72a-4bb8-9c3e-ca3107e69a32 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] snapshot_file for this snap is: volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:33:55 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f12de5-1b9b-40b5-9b90-e1868fd102a7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1 1073741824" returned: 0 in 0.695s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:55 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1 Sep 23 00:33:55 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:55 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e Sep 23 00:33:55 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:55 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1" returned: 0 in 0.332s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.852s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1418610022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c40edf-e8b8-4b79-b588-97d63fc49d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e4c65666924c0db5ca0f41da68c21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:55Z,use_quota=True,user_id='3afa771112314ece83e0bda3e7365d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Creating volume e6c40edf-e8b8-4b79-b588-97d63fc49d1b {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:55 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:55 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e" returned: 0 in 0.427s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:33:55 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b 1073741824 Sep 23 00:33:55 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0d5ec7-4490-43f9-950a-d7388d9428ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380b1aaa-fabf-47b6-ab69-a78f5ae51130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1ad5d5-b4bc-4218-9fa8-8cfe13385a6e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:55 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Volume volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1 (97ad5bfc-7da7-4116-9eca-f66149f82dd1): created successfully Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380b1aaa-fabf-47b6-ab69-a78f5ae51130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:55 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Flow 'volume_create_manager' (00657b15-f203-4114-b843-5e6d9f121d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:56 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2f5d70da-1f2a-4954-97fd-772b198ae077 tempest-ProjectReaderTests-879466599 None] Created volume successfully. Sep 23 00:33:56 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 Sep 23 00:33:56 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:56 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:56 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32" returned: 0 in 0.554s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b 1073741824" returned: 0 in 0.660s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:56 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e Sep 23 00:33:56 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Acquiring lock "cinder-97ad5bfc-7da7-4116-9eca-f66149f82dd1-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Lock "cinder-97ad5bfc-7da7-4116-9eca-f66149f82dd1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:56 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b Sep 23 00:33:56 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Acquiring lock "cinder-quobyte-97ad5bfc-7da7-4116-9eca-f66149f82dd1" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:56 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Lock "cinder-quobyte-97ad5bfc-7da7-4116-9eca-f66149f82dd1" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:56 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d5f8aa-a7a5-4fc3-b037-efe753c7e019]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:56 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:56 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1 Sep 23 00:33:56 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:57 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b" returned: 0 in 0.435s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c6b7a7-8948-4935-ba91-0bcc0167fb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bbd112-2992-44a2-aba6-314312e17d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:57 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Volume volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b (e6c40edf-e8b8-4b79-b588-97d63fc49d1b): created successfully Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bbd112-2992-44a2-aba6-314312e17d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Flow 'volume_create_manager' (192149b0-392e-4ad7-8974-dab38c0c965c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:57 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e" returned: 0 in 0.575s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:57 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-693da55f-c590-46f4-9d6a-172390ce57ad tempest-SnapshotDependencyTests-428432490 None] Created volume successfully. Sep 23 00:33:57 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e Sep 23 00:33:57 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:57 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1" returned: 0 in 0.522s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:57 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1 Sep 23 00:33:57 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:57 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32.1ee8f170-7253-44ed-aa87-aec341993e6e" returned: 0 in 0.314s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-1ee8f170-7253-44ed-aa87-aec341993e6e" released by "_delete_snapshot" :: held 2.044s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-449f7a86-f72a-4bb8-9c3e-ca3107e69a32" released by "delete_snapshot" :: held 2.075s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Created reservations ['c3b37e68-7245-405e-83e2-ad7506f437ce', 'df8456e7-dc53-492a-91a1-aa7c1d32ab79', '64246011-28bf-46ef-a4d9-ad165bc11c5b', '972c255a-1b3e-4f02-b7f2-d6aec7ca0c8e'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:57 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-97ad5bfc-7da7-4116-9eca-f66149f82dd1" returned: 0 in 0.354s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Lock "cinder-quobyte-97ad5bfc-7da7-4116-9eca-f66149f82dd1" released by "delete_volume" :: held 0.941s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:57 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Delete snapshot completed successfully. Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-c995ef49-a4f8-4d4d-9295-8eaa29c5b4ba tempest-ProjectMemberTests-1420876395 None] Lock "cinder-1ee8f170-7253-44ed-aa87-aec341993e6e-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Created reservations ['f6ae4dc6-a267-4e51-8064-d40d18c2800f', 'f2454640-c04b-42ba-bd49-2981d06d4170', '771789be-d6a9-49c1-bdc9-c3d4efa52f39', '04795f34-b296-48f1-9735-daf86c022975'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:57 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:57 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:57 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:58 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.362s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:58 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Deleted volume successfully. Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-214d263c-5f8d-4e31-aa18-9a0bcb1b049d tempest-ProjectReaderTests-879466599 None] Lock "cinder-97ad5bfc-7da7-4116-9eca-f66149f82dd1-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=187,cinder:UPDATE=240,cinder:DELETE=22,cinder:INSERT=63 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Flow 'volume_create_manager' (355f7f08-181d-460a-990a-436d0aba6258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d06712-01b7-4ddb-af31-16270d61de81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-449f7a86-f72a-4bb8-9c3e-ca3107e69a32-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] Creating offline snapshot 7e1bf617-4581-49fb-8113-055a8e641b3f of volume e6c40edf-e8b8-4b79-b588-97d63fc49d1b {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=167,cinder:INSERT=62,cinder:UPDATE=235,cinder:DELETE=17 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d06712-01b7-4ddb-af31-16270d61de81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1540026447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a8e220-8033-4ca5-bb13-6e36c1fa7577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427a0cb275b44ff6b9ef25cb6adc13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:59Z,use_quota=True,user_id='defa54c83fb7449cbd58a1eff4774ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66c1c58-21a5-465b-92a6-dbf31282c303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66c1c58-21a5-465b-92a6-dbf31282c303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d566a2a-60df-4dc3-9ada-56be1528cfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d566a2a-60df-4dc3-9ada-56be1528cfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a8e220-8033-4ca5-bb13-6e36c1fa7577', 'volume_name': 'volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbf6115-f7fc-4ab2-a9cf-a5a8d25f23bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbf6115-f7fc-4ab2-a9cf-a5a8d25f23bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3e3e1f-8a4d-4376-aa3e-a810edd6853c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:58 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Volume 51a8e220-8033-4ca5-bb13-6e36c1fa7577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577', 'volume_size': 1} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Lock "cinder-449f7a86-f72a-4bb8-9c3e-ca3107e69a32-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7003c5d-b2f9-4fc9-ac9f-72ab022fdcb3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-449f7a86-f72a-4bb8-9c3e-ca3107e69a32" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-449f7a86-f72a-4bb8-9c3e-ca3107e69a32" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:58 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[48acca34-0ba0-4cca-9b4c-b4f6e9f2b3a8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:58 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:58 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:58 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 Sep 23 00:33:58 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:59 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b" returned: 0 in 0.411s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:59 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f 1G Sep 23 00:33:59 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:59 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32" returned: 0 in 0.406s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:59 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32 Sep 23 00:33:59 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:59 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-449f7a86-f72a-4bb8-9c3e-ca3107e69a32" returned: 0 in 0.269s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-449f7a86-f72a-4bb8-9c3e-ca3107e69a32" released by "delete_volume" :: held 0.747s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Created reservations ['e857aca2-9a3a-481f-a41b-56ce2674dab3', '01d2c3da-d222-4d7f-b7a5-04feeae45215', '2cabc69b-796a-4d5a-8180-f7a08c17b495', 'a7a2b0d4-6c79-4524-b965-ad0999457cec'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:33:59 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f 1G" returned: 0 in 0.482s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:59 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f Sep 23 00:33:59 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:59 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:33:59 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:59 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.274s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:59 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Deleted volume successfully. Sep 23 00:33:59 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f" returned: 0 in 0.355s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:59 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f is being set with open permissions: ugo+rw Sep 23 00:33:59 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:00 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f Sep 23 00:34:00 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-fb2d0d2a-e967-40f4-9bd0-94f3b165280b tempest-ProjectMemberTests-1420876395 None] Lock "cinder-449f7a86-f72a-4bb8-9c3e-ca3107e69a32-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:00 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f" returned: 0 in 0.266s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:00 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.info Sep 23 00:34:00 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (907e08f4-c4e4-4c76-bb0b-1447db4b969b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6bf060-3af9-4035-9ea4-d174a1b82b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6bf060-3af9-4035-9ea4-d174a1b82b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1284328912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197c87f2-d930-48bf-bec3-d70137a2e9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:00Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f27a4d-e4cc-41e2-8170-573c22ea8cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f27a4d-e4cc-41e2-8170-573c22ea8cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d5bfa7-bc6c-40c1-9b57-48f8ddbbcf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d5bfa7-bc6c-40c1-9b57-48f8ddbbcf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197c87f2-d930-48bf-bec3-d70137a2e9b8', 'volume_name': 'volume-197c87f2-d930-48bf-bec3-d70137a2e9b8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f134536-1954-4eef-b105-a457be3474a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f134536-1954-4eef-b105-a457be3474a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770860ab-371e-4ef6-9af5-1c392e51f413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:00 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Volume 197c87f2-d930-48bf-bec3-d70137a2e9b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197c87f2-d930-48bf-bec3-d70137a2e9b8', 'volume_size': 1} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:00 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.info" returned: 0 in 0.276s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:00 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.info is being set with open permissions: ugo+rw Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:00 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.info Sep 23 00:34:00 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:00 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.info" returned: 0 in 0.257s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.117s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1540026447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a8e220-8033-4ca5-bb13-6e36c1fa7577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427a0cb275b44ff6b9ef25cb6adc13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:59Z,use_quota=True,user_id='defa54c83fb7449cbd58a1eff4774ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Creating volume 51a8e220-8033-4ca5-bb13-6e36c1fa7577 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:00 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:34:00 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:00 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577 1073741824 Sep 23 00:34:00 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:00 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-db8bcefa-132f-4129-a060-49061cf268ab tempest-SnapshotDependencyTests-428432490 None] Create snapshot completed successfully Sep 23 00:34:01 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577 1073741824" returned: 0 in 0.496s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:01 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577 Sep 23 00:34:01 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:01 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577" returned: 0 in 0.271s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.234s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1284328912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197c87f2-d930-48bf-bec3-d70137a2e9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:00Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Creating volume 197c87f2-d930-48bf-bec3-d70137a2e9b8 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:01 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:01 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 1073741824 Sep 23 00:34:01 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3e3e1f-8a4d-4376-aa3e-a810edd6853c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4c79aa-1e0c-4eb5-98da-778d24dfce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:01 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Volume volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577 (51a8e220-8033-4ca5-bb13-6e36c1fa7577): created successfully Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4c79aa-1e0c-4eb5-98da-778d24dfce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:01 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Flow 'volume_create_manager' (355f7f08-181d-460a-990a-436d0aba6258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:01 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-7e8b3fb8-b9be-47ab-b51a-ccc1bc0c0229 tempest-ProjectReaderTests-879466599 None] Created volume successfully. Sep 23 00:34:02 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 1073741824" returned: 0 in 0.616s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Flow 'volume_create_manager' (383be75e-20c1-444b-906f-81f574df2887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91aae908-c6a3-475d-a3d7-b067316d7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91aae908-c6a3-475d-a3d7-b067316d7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338fd8b8-5296-48f6-bfa4-1b1af995ce32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e4c65666924c0db5ca0f41da68c21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e1bf617-4581-49fb-8113-055a8e641b3f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:02Z,use_quota=True,user_id='3afa771112314ece83e0bda3e7365d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:02 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 Sep 23 00:34:02 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00dfec1-f460-4f8a-b889-b63f8e7e6548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00dfec1-f460-4f8a-b889-b63f8e7e6548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa1acb2-8f0a-4305-ace7-41bb9b0aea47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa1acb2-8f0a-4305-ace7-41bb9b0aea47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '338fd8b8-5296-48f6-bfa4-1b1af995ce32', 'volume_name': 'volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32', 'volume_size': 1, 'snapshot_id': '7e1bf617-4581-49fb-8113-055a8e641b3f'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f426ccd-4d43-436d-b041-663b6168de29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f426ccd-4d43-436d-b041-663b6168de29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97989924-04e5-4f2a-981a-6b7394e69861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:02 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Volume 338fd8b8-5296-48f6-bfa4-1b1af995ce32: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32', 'volume_size': 1, 'snapshot_id': '7e1bf617-4581-49fb-8113-055a8e641b3f'} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:02 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8" returned: 0 in 0.277s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.210s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "cinder-quobyte-7e1bf617-4581-49fb-8113-055a8e641b3f-338fd8b8-5296-48f6-bfa4-1b1af995ce32" by "_create_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770860ab-371e-4ef6-9af5-1c392e51f413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197c87f2-d930-48bf-bec3-d70137a2e9b8', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bf3333-6f68-4f1e-bc56-14c4b2ed009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-quobyte-7e1bf617-4581-49fb-8113-055a8e641b3f-338fd8b8-5296-48f6-bfa4-1b1af995ce32" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Creating volume 338fd8b8-5296-48f6-bfa4-1b1af995ce32 from snapshot 7e1bf617-4581-49fb-8113-055a8e641b3f {{(pid=86481) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "cinder-quobyte-338fd8b8-5296-48f6-bfa4-1b1af995ce32" by "_copy_volume_from_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:02 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Volume volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 (197c87f2-d930-48bf-bec3-d70137a2e9b8): created successfully Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bf3333-6f68-4f1e-bc56-14c4b2ed009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (907e08f4-c4e4-4c76-bb0b-1447db4b969b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-quobyte-338fd8b8-5296-48f6-bfa4-1b1af995ce32" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] snapshot: 7e1bf617-4581-49fb-8113-055a8e641b3f, volume: 338fd8b8-5296-48f6-bfa4-1b1af995ce32, {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:34:02 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-154ad79a-22e1-46d4-906a-a0c725f508b8 tempest-ProjectMemberTests-1420876395 None] Created volume successfully. Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9899d26-7ff7-4bcc-9dfe-d1f62c31456c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Acquiring lock "cinder-51a8e220-8033-4ca5-bb13-6e36c1fa7577-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Lock "cinder-51a8e220-8033-4ca5-bb13-6e36c1fa7577-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Acquiring lock "cinder-quobyte-51a8e220-8033-4ca5-bb13-6e36c1fa7577" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Lock "cinder-quobyte-51a8e220-8033-4ca5-bb13-6e36c1fa7577" acquired by "delete_volume" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:02 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f Sep 23 00:34:02 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fd9463-d4a2-4a1c-8fce-30ae05eda99e]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:02 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:03 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577 Sep 23 00:34:03 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f" returned: 0 in 0.433s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d9f13b-c304-49f7-95b3-5a72f21029c0]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:03 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b Sep 23 00:34:03 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577" returned: 0 in 0.469s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:03 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577 Sep 23 00:34:03 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:03 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-51a8e220-8033-4ca5-bb13-6e36c1fa7577" returned: 0 in 0.340s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Lock "cinder-quobyte-51a8e220-8033-4ca5-bb13-6e36c1fa7577" released by "delete_volume" :: held 0.873s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b" returned: 0 in 0.531s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Creating direct copy from snapshot {{(pid=86481) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG cinder.utils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Path /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32 not found in is_blk_device check {{(pid=86481) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:03 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32 Sep 23 00:34:03 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Created reservations ['44673f70-76df-4ca4-bd74-577b837fedd9', '8db6e91c-6082-4d72-b8ca-b3bdd7eb6fab', 'b79b6d8b-d3d5-4978-b141-006462f66bdd', 'd96dc06c-5ad8-41a7-b792-fdbc6cb55ec0'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:03 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:04 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:34:04 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:04 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:04 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.320s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:04 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:04 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Deleted volume successfully. Sep 23 00:34:04 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-b50a5fe2-db10-4c49-9d74-08ba1cdec577 tempest-ProjectReaderTests-879466599 None] Lock "cinder-51a8e220-8033-4ca5-bb13-6e36c1fa7577-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:04 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Flow 'volume_create_manager' (2aa07896-0e5f-4874-9c85-ab384767194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6aa6f3-c9b3-401b-bfe7-1be32a9c80e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6aa6f3-c9b3-401b-bfe7-1be32a9c80e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055335001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9a7aad-5450-49be-b707-47d971332947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427a0cb275b44ff6b9ef25cb6adc13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:05Z,use_quota=True,user_id='defa54c83fb7449cbd58a1eff4774ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347347e3-c278-4207-b9d9-131e2db38e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347347e3-c278-4207-b9d9-131e2db38e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:04 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85a38fb-f42a-475c-ac28-191eac390375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85a38fb-f42a-475c-ac28-191eac390375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee9a7aad-5450-49be-b707-47d971332947', 'volume_name': 'volume-ee9a7aad-5450-49be-b707-47d971332947', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659540dd-4b1e-4311-ae7d-bc0a1905e9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659540dd-4b1e-4311-ae7d-bc0a1905e9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:05 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af774f4f-21c1-4b6f-82c7-891ca5b3600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:05 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Volume ee9a7aad-5450-49be-b707-47d971332947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee9a7aad-5450-49be-b707-47d971332947', 'volume_size': 1} Sep 23 00:34:05 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:10 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32" returned: 0 in 7.037s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:10 devstack cinder-volume[86481]: DEBUG cinder.image.image_utils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Image conversion details: src /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b, size 1024.00 MB, duration 7.04 sec, destination /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32 {{(pid=86481) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:34:10 devstack cinder-volume[86481]: INFO cinder.image.image_utils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Converted 1024.00 MB image at 145.50 MB/s Sep 23 00:34:10 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32 is being set with open permissions: ugo+rw Sep 23 00:34:10 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:10 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32 Sep 23 00:34:10 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:11 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32" returned: 0 in 0.324s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-quobyte-338fd8b8-5296-48f6-bfa4-1b1af995ce32" released by "_copy_volume_from_snapshot" :: held 8.445s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-quobyte-7e1bf617-4581-49fb-8113-055a8e641b3f-338fd8b8-5296-48f6-bfa4-1b1af995ce32" released by "_create_volume_from_snapshot" :: held 8.546s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.579s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.467s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] Creating offline snapshot 3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 of volume 197c87f2-d930-48bf-bec3-d70137a2e9b8 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97989924-04e5-4f2a-981a-6b7394e69861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32', 'volume_size': 1, 'snapshot_id': '7e1bf617-4581-49fb-8113-055a8e641b3f'}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4517b1a-34f8-4a06-bb56-bd47a4eb673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb68bb1-35b6-491e-99da-552ffcf0071f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:11 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Volume volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32 (338fd8b8-5296-48f6-bfa4-1b1af995ce32): created successfully Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4517b1a-34f8-4a06-bb56-bd47a4eb673f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Flow 'volume_create_manager' (383be75e-20c1-444b-906f-81f574df2887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:11 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-3f807ae9-b1fc-4edc-9b20-ca846ca359ed tempest-SnapshotDependencyTests-428432490 None] Created volume successfully. Sep 23 00:34:11 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 Sep 23 00:34:11 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:11 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8" returned: 0 in 0.452s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:11 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:11 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 1G Sep 23 00:34:11 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 1G" returned: 0 in 0.565s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "cinder-7e1bf617-4581-49fb-8113-055a8e641b3f-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:12 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 Sep 23 00:34:12 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-7e1bf617-4581-49fb-8113-055a8e641b3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "cinder-quobyte-e6c40edf-e8b8-4b79-b588-97d63fc49d1b" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-quobyte-e6c40edf-e8b8-4b79-b588-97d63fc49d1b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "cinder-quobyte-7e1bf617-4581-49fb-8113-055a8e641b3f" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-quobyte-7e1bf617-4581-49fb-8113-055a8e641b3f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Deleting offline snapshot 7e1bf617-4581-49fb-8113-055a8e641b3f of volume e6c40edf-e8b8-4b79-b588-97d63fc49d1b {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] snapshot_file for this snap is: volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac82fdf9-0dea-4957-8d5e-c6ba77907ef1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f Sep 23 00:34:12 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80" returned: 0 in 0.382s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 is being set with open permissions: ugo+rw Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 Sep 23 00:34:12 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:12 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f" returned: 0 in 0.460s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbe2f98-1d08-43fd-8a2e-c433d0996d01]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:12 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:12 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80" returned: 0 in 0.301s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:13 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.info Sep 23 00:34:13 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:13 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b Sep 23 00:34:13 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:13 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.info" returned: 0 in 0.297s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:13 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.info is being set with open permissions: ugo+rw Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:13 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.info Sep 23 00:34:13 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:13 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b" returned: 0 in 0.638s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:13 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f Sep 23 00:34:13 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:13 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.info" returned: 0 in 0.316s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.432s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.643s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055335001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9a7aad-5450-49be-b707-47d971332947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427a0cb275b44ff6b9ef25cb6adc13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:05Z,use_quota=True,user_id='defa54c83fb7449cbd58a1eff4774ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Creating volume ee9a7aad-5450-49be-b707-47d971332947 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:13 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:34:13 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ee9a7aad-5450-49be-b707-47d971332947 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:13 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ee9a7aad-5450-49be-b707-47d971332947 1073741824 Sep 23 00:34:13 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:13 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-43a68027-f3da-411c-8cfd-fe5119f859a0 tempest-ProjectMemberTests-1420876395 None] Create snapshot completed successfully Sep 23 00:34:14 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f" returned: 0 in 0.414s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:14 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f Sep 23 00:34:14 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ee9a7aad-5450-49be-b707-47d971332947 1073741824" returned: 0 in 0.556s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ee9a7aad-5450-49be-b707-47d971332947 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:14 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ee9a7aad-5450-49be-b707-47d971332947 Sep 23 00:34:14 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b.7e1bf617-4581-49fb-8113-055a8e641b3f" returned: 0 in 0.337s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-3a8a8191-b4f6-486e-bfc6-346d2ca0fb80-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-quobyte-7e1bf617-4581-49fb-8113-055a8e641b3f" released by "_delete_snapshot" :: held 2.023s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-3a8a8191-b4f6-486e-bfc6-346d2ca0fb80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-197c87f2-d930-48bf-bec3-d70137a2e9b8" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-quobyte-e6c40edf-e8b8-4b79-b588-97d63fc49d1b" released by "delete_snapshot" :: held 2.071s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-197c87f2-d930-48bf-bec3-d70137a2e9b8" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-3a8a8191-b4f6-486e-bfc6-346d2ca0fb80" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-3a8a8191-b4f6-486e-bfc6-346d2ca0fb80" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Deleting offline snapshot 3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 of volume 197c87f2-d930-48bf-bec3-d70137a2e9b8 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] snapshot_file for this snap is: volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2887499-eed1-49a9-be85-767f36776da2]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:14 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ee9a7aad-5450-49be-b707-47d971332947" returned: 0 in 0.319s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Created reservations ['765bb80c-e0f8-4177-9f98-d3dba5ed9c0d', '123e2b7f-e886-4add-ab90-799e30f6e98f', '3e25f491-f84d-4622-b7d3-1fd7b77f8091', '36520b3b-4002-4c6c-a7d0-9d053cf12452'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af774f4f-21c1-4b6f-82c7-891ca5b3600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee9a7aad-5450-49be-b707-47d971332947', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184ed207-d499-4fc1-8b55-3d4fcbda1f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:14 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Volume volume-ee9a7aad-5450-49be-b707-47d971332947 (ee9a7aad-5450-49be-b707-47d971332947): created successfully Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (184ed207-d499-4fc1-8b55-3d4fcbda1f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Flow 'volume_create_manager' (2aa07896-0e5f-4874-9c85-ab384767194f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:14 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d18b989a-afba-48de-ada3-990a56967f54 tempest-ProjectReaderTests-879466599 None] Created volume successfully. Sep 23 00:34:14 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 Sep 23 00:34:14 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:14 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Delete snapshot completed successfully. Sep 23 00:34:14 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-221579fb-1fc4-49d1-a1cc-29f7a13835ea tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-7e1bf617-4581-49fb-8113-055a8e641b3f-delete_snapshot" released by "delete_snapshot" :: held 2.363s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:15 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80" returned: 0 in 0.473s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-197c87f2-d930-48bf-bec3-d70137a2e9b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a96ac3a-a717-41d6-87d5-3eb0fa6fcee7]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 Sep 23 00:34:15 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:15 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8" returned: 0 in 0.424s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 Sep 23 00:34:15 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "cinder-e6c40edf-e8b8-4b79-b588-97d63fc49d1b-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-e6c40edf-e8b8-4b79-b588-97d63fc49d1b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "cinder-quobyte-e6c40edf-e8b8-4b79-b588-97d63fc49d1b" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-quobyte-e6c40edf-e8b8-4b79-b588-97d63fc49d1b" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Acquiring lock "cinder-ee9a7aad-5450-49be-b707-47d971332947-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70aab8b-d0eb-482b-9bc4-90d7d15f1ba1]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Lock "cinder-ee9a7aad-5450-49be-b707-47d971332947-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Acquiring lock "cinder-quobyte-ee9a7aad-5450-49be-b707-47d971332947" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Lock "cinder-quobyte-ee9a7aad-5450-49be-b707-47d971332947" acquired by "delete_volume" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b127fde-0f9f-439c-8ca0-1b026b6cb58b]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ee9a7aad-5450-49be-b707-47d971332947 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:15 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b Sep 23 00:34:15 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:15 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80" returned: 0 in 0.472s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:15 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80 Sep 23 00:34:16 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ee9a7aad-5450-49be-b707-47d971332947 Sep 23 00:34:16 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b" returned: 0 in 0.460s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b Sep 23 00:34:16 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8.3a8a8191-b4f6-486e-bfc6-346d2ca0fb80" returned: 0 in 0.383s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ee9a7aad-5450-49be-b707-47d971332947" returned: 0 in 0.446s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ee9a7aad-5450-49be-b707-47d971332947 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-3a8a8191-b4f6-486e-bfc6-346d2ca0fb80" released by "_delete_snapshot" :: held 1.900s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-197c87f2-d930-48bf-bec3-d70137a2e9b8" released by "delete_snapshot" :: held 1.945s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:16 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ee9a7aad-5450-49be-b707-47d971332947 Sep 23 00:34:16 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Created reservations ['6076fa8c-9300-44ae-8d14-59c031f13399', 'be3a4241-770b-4e4a-8b13-bab8d66f45a8', '7c7e41ef-f49a-406f-8a44-c80ccfa77994', 'afee1f44-fff2-4c88-b8f4-e2d9aee7df0c'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:16 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Delete snapshot completed successfully. Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2f2ffd05-d84f-4d3c-957b-fb3c5768f9f5 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-3a8a8191-b4f6-486e-bfc6-346d2ca0fb80-delete_snapshot" released by "delete_snapshot" :: held 2.168s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:16 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e6c40edf-e8b8-4b79-b588-97d63fc49d1b" returned: 0 in 0.326s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-quobyte-e6c40edf-e8b8-4b79-b588-97d63fc49d1b" released by "delete_volume" :: held 0.880s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Created reservations ['c62702cc-2099-4682-bd1f-f0a239a84ac9', 'be08e1c4-baf1-436f-a280-63e375ab2321', '47bbbbc2-fcf7-4203-acfa-2a08e41571b5', 'd2d07498-8d0e-43f7-af85-b9a3487b3c19'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:16 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-ee9a7aad-5450-49be-b707-47d971332947" returned: 0 in 0.298s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Lock "cinder-quobyte-ee9a7aad-5450-49be-b707-47d971332947" released by "delete_volume" :: held 0.807s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:16 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:34:16 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Created reservations ['d2462391-015f-46e6-8010-612823828231', '636b81a8-9501-4666-99ed-90a90d2a62b2', '81e866c6-5ff1-47de-a1ac-4b3d9fdc8c34', '7e7d5589-3209-48c2-aa45-c00f0451d32c'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:16 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:17 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:34:17 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:17 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.334s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Deleted volume successfully. Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-6c3ba58d-4e69-4a73-abdd-5290600de212 tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-e6c40edf-e8b8-4b79-b588-97d63fc49d1b-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:17 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.329s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:17 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Deleted volume successfully. Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-ac04472f-f04a-46eb-aef3-d4986d32080e tempest-ProjectReaderTests-879466599 None] Lock "cinder-ee9a7aad-5450-49be-b707-47d971332947-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-197c87f2-d930-48bf-bec3-d70137a2e9b8-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-197c87f2-d930-48bf-bec3-d70137a2e9b8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-197c87f2-d930-48bf-bec3-d70137a2e9b8" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-197c87f2-d930-48bf-bec3-d70137a2e9b8" acquired by "delete_volume" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51a03e0-088b-4bdd-83f0-1b44789f316a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:17 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 Sep 23 00:34:17 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "cinder-338fd8b8-5296-48f6-bfa4-1b1af995ce32-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-338fd8b8-5296-48f6-bfa4-1b1af995ce32-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:17 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "cinder-quobyte-338fd8b8-5296-48f6-bfa4-1b1af995ce32" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-quobyte-338fd8b8-5296-48f6-bfa4-1b1af995ce32" acquired by "delete_volume" :: waited 0.040s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2df8aa-ff10-4e84-9535-8b58c01671c3]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:18 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32 Sep 23 00:34:18 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8" returned: 0 in 0.474s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:18 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8 Sep 23 00:34:18 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-197c87f2-d930-48bf-bec3-d70137a2e9b8" returned: 0 in 0.309s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-197c87f2-d930-48bf-bec3-d70137a2e9b8" released by "delete_volume" :: held 0.875s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:18 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32" returned: 0 in 0.520s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:18 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32 Sep 23 00:34:18 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Created reservations ['378cb722-65f4-45f7-b236-d8ec2a8843f3', '274bc395-591a-487d-bb11-f220d8ef62f4', 'afff85da-388f-47d5-b562-722634d37e79', '99a9e928-476a-4fc4-bee5-60fde51ed5f8'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Flow 'volume_create_manager' (d67f277b-d139-4794-8b8b-593d10551b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bab4f2d-40fd-44c1-b7be-5553916b655b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bab4f2d-40fd-44c1-b7be-5553916b655b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899261918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8243db0-f515-4a61-bcb4-6813a31b22c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427a0cb275b44ff6b9ef25cb6adc13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:19Z,use_quota=True,user_id='defa54c83fb7449cbd58a1eff4774ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673b0903-1542-4d0c-80c0-ac992c3aa449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673b0903-1542-4d0c-80c0-ac992c3aa449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1145aaf-38ca-46b2-adbc-91fa15fa1c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1145aaf-38ca-46b2-adbc-91fa15fa1c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8243db0-f515-4a61-bcb4-6813a31b22c7', 'volume_name': 'volume-e8243db0-f515-4a61-bcb4-6813a31b22c7', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10d13c4-9660-4087-b1c4-04c7d162ae8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10d13c4-9660-4087-b1c4-04c7d162ae8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce704cf1-ae34-4d66-bf6e-37e59f583c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:18 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Volume e8243db0-f515-4a61-bcb4-6813a31b22c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8243db0-f515-4a61-bcb4-6813a31b22c7', 'volume_size': 1} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899261918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8243db0-f515-4a61-bcb4-6813a31b22c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427a0cb275b44ff6b9ef25cb6adc13a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:19Z,use_quota=True,user_id='defa54c83fb7449cbd58a1eff4774ec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Creating volume e8243db0-f515-4a61-bcb4-6813a31b22c7 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:18 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8243db0-f515-4a61-bcb4-6813a31b22c7 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:18 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8243db0-f515-4a61-bcb4-6813a31b22c7 1073741824 Sep 23 00:34:18 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:18 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-338fd8b8-5296-48f6-bfa4-1b1af995ce32" returned: 0 in 0.343s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:18 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:34:18 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:18 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-quobyte-338fd8b8-5296-48f6-bfa4-1b1af995ce32" released by "delete_volume" :: held 0.951s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Created reservations ['c147b413-1350-42a1-a7a8-8b69f4d572d6', 'b452a939-04d0-4830-944a-4fd582e069f8', 'a6eba5da-ef59-4868-bac6-332c8743290a', 'fa3eb0d4-9eee-4dcc-b5a9-c5804bd12195'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:19 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:34:19 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:19 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.334s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:19 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Deleted volume successfully. Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-f428335f-cdf9-4e58-9c6d-0fc86ea30f4c tempest-ProjectMemberTests-1420876395 None] Lock "cinder-197c87f2-d930-48bf-bec3-d70137a2e9b8-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:19 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8243db0-f515-4a61-bcb4-6813a31b22c7 1073741824" returned: 0 in 0.593s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8243db0-f515-4a61-bcb4-6813a31b22c7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:19 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8243db0-f515-4a61-bcb4-6813a31b22c7 Sep 23 00:34:19 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:19 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.345s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:19 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Deleted volume successfully. Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-5019af13-761b-4811-bce7-d7fe2e9587a6 tempest-SnapshotDependencyTests-428432490 None] Lock "cinder-338fd8b8-5296-48f6-bfa4-1b1af995ce32-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:19 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8243db0-f515-4a61-bcb4-6813a31b22c7" returned: 0 in 0.307s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce704cf1-ae34-4d66-bf6e-37e59f583c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8243db0-f515-4a61-bcb4-6813a31b22c7', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab82fb5-c31c-4158-8a90-23968318120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:19 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Volume volume-e8243db0-f515-4a61-bcb4-6813a31b22c7 (e8243db0-f515-4a61-bcb4-6813a31b22c7): created successfully Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab82fb5-c31c-4158-8a90-23968318120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:19 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Flow 'volume_create_manager' (d67f277b-d139-4794-8b8b-593d10551b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:19 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-93b190df-fdd7-446e-b72c-ea64b9715d1a tempest-ProjectReaderTests-879466599 None] Created volume successfully. Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (5aaf5297-e155-4c03-a98c-c9cf0111ae14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f0e549-4ada-40f8-b0a0-3a0f14df3b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f0e549-4ada-40f8-b0a0-3a0f14df3b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842276369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38d04c6-7530-4198-b2a2-cc5f591b1bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:20Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbb7af8-04f0-45b2-aff3-647c056497fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dbb7af8-04f0-45b2-aff3-647c056497fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88057b14-6a7b-4bd2-bfb9-51f243c22e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88057b14-6a7b-4bd2-bfb9-51f243c22e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38d04c6-7530-4198-b2a2-cc5f591b1bf5', 'volume_name': 'volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b7a2d8-36e5-4271-a134-c887f2422564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b7a2d8-36e5-4271-a134-c887f2422564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab570da3-06bf-4515-9f96-62df45ee16d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:20 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Volume e38d04c6-7530-4198-b2a2-cc5f591b1bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5', 'volume_size': 1} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842276369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38d04c6-7530-4198-b2a2-cc5f591b1bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:20Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Creating volume e38d04c6-7530-4198-b2a2-cc5f591b1bf5 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:20 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:20 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 1073741824 Sep 23 00:34:20 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Acquiring lock "cinder-e8243db0-f515-4a61-bcb4-6813a31b22c7-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Lock "cinder-e8243db0-f515-4a61-bcb4-6813a31b22c7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Acquiring lock "cinder-quobyte-e8243db0-f515-4a61-bcb4-6813a31b22c7" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Lock "cinder-quobyte-e8243db0-f515-4a61-bcb4-6813a31b22c7" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5cbf5c-e29f-4df4-a19f-e0ea1c556eef]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:20 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8243db0-f515-4a61-bcb4-6813a31b22c7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:21 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 1073741824" returned: 0 in 0.569s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:21 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8243db0-f515-4a61-bcb4-6813a31b22c7 Sep 23 00:34:21 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:21 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 Sep 23 00:34:21 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:21 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5" returned: 0 in 0.342s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab570da3-06bf-4515-9f96-62df45ee16d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cd2c55-a0ea-4e64-8158-d0a8b37b0b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:21 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Volume volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 (e38d04c6-7530-4198-b2a2-cc5f591b1bf5): created successfully Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cd2c55-a0ea-4e64-8158-d0a8b37b0b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (5aaf5297-e155-4c03-a98c-c9cf0111ae14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:21 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-19f708b0-a2b2-4b61-babf-f13a018d8317 tempest-ProjectMemberTests-1420876395 None] Created volume successfully. Sep 23 00:34:21 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8243db0-f515-4a61-bcb4-6813a31b22c7" returned: 0 in 0.602s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8243db0-f515-4a61-bcb4-6813a31b22c7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:21 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8243db0-f515-4a61-bcb4-6813a31b22c7 Sep 23 00:34:21 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:21 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e8243db0-f515-4a61-bcb4-6813a31b22c7" returned: 0 in 0.294s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Lock "cinder-quobyte-e8243db0-f515-4a61-bcb4-6813a31b22c7" released by "delete_volume" :: held 0.951s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:21 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Created reservations ['8e170a31-e194-4159-8731-52248d4754ae', '5c246a2b-27d0-4f7f-9d0c-64ba8f34d666', '018c425d-9426-4a2f-ac42-cca6890c4c05', '41d134ea-5bda-4d6f-b818-ce4baf7f6cdb'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:22 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:34:22 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:22 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.306s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:22 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Deleted volume successfully. Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-4bc03189-cc96-4cae-b040-a75ba3ed550b tempest-ProjectReaderTests-879466599 None] Lock "cinder-e8243db0-f515-4a61-bcb4-6813a31b22c7-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] Creating offline snapshot b68efd3f-a9c8-4b55-b8af-a92926f1021c of volume e38d04c6-7530-4198-b2a2-cc5f591b1bf5 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19a80f6-0daa-443e-9343-b2c7c674647f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:22 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:22 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 Sep 23 00:34:22 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:23 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5" returned: 0 in 0.489s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:23 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c 1G Sep 23 00:34:23 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:23 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c 1G" returned: 0 in 0.617s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:23 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:23 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c Sep 23 00:34:23 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:24 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c" returned: 0 in 0.464s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:24 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c is being set with open permissions: ugo+rw Sep 23 00:34:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:24 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c Sep 23 00:34:24 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:24 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c" returned: 0 in 0.364s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:24 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:24 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.info Sep 23 00:34:24 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.info" returned: 0 in 0.357s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.info is being set with open permissions: ugo+rw Sep 23 00:34:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:25 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.info Sep 23 00:34:25 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:25 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.info" returned: 0 in 0.447s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:25 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:25 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1499f9bb-9b24-43d2-9105-79e3f98c5eaa tempest-ProjectMemberTests-1420876395 None] Create snapshot completed successfully Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-b68efd3f-a9c8-4b55-b8af-a92926f1021c-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-b68efd3f-a9c8-4b55-b8af-a92926f1021c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-e38d04c6-7530-4198-b2a2-cc5f591b1bf5" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-e38d04c6-7530-4198-b2a2-cc5f591b1bf5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-b68efd3f-a9c8-4b55-b8af-a92926f1021c" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-b68efd3f-a9c8-4b55-b8af-a92926f1021c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Deleting offline snapshot b68efd3f-a9c8-4b55-b8af-a92926f1021c of volume e38d04c6-7530-4198-b2a2-cc5f591b1bf5 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] snapshot_file for this snap is: volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4464d3e-921c-4b7b-a117-877b1c0fd6db]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:26 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c Sep 23 00:34:26 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:26 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c" returned: 0 in 0.508s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddd51d5-23ca-4db2-bdb6-a7bbb5903f71]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:26 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:26 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 Sep 23 00:34:26 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:27 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5" returned: 0 in 0.453s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:27 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c Sep 23 00:34:27 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:27 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c" returned: 0 in 0.394s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:27 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c Sep 23 00:34:27 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:27 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:27 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5.b68efd3f-a9c8-4b55-b8af-a92926f1021c" returned: 0 in 0.313s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-b68efd3f-a9c8-4b55-b8af-a92926f1021c" released by "_delete_snapshot" :: held 1.819s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:27 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-e38d04c6-7530-4198-b2a2-cc5f591b1bf5" released by "delete_snapshot" :: held 1.843s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:28 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Created reservations ['99d83048-3866-4176-b639-f76d009df56e', '9a7539b0-12b3-4da3-8b28-60828197296a', 'b121dbb8-8fd7-4389-80c6-6b41b95dd9cc', '956e0413-070b-4af8-8c54-684cafe10553'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:28 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Delete snapshot completed successfully. Sep 23 00:34:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2da49f81-52f7-492c-86ee-b446b6884cb2 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-b68efd3f-a9c8-4b55-b8af-a92926f1021c-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-e38d04c6-7530-4198-b2a2-cc5f591b1bf5-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-e38d04c6-7530-4198-b2a2-cc5f591b1bf5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-e38d04c6-7530-4198-b2a2-cc5f591b1bf5" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:28 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-e38d04c6-7530-4198-b2a2-cc5f591b1bf5" acquired by "delete_volume" :: waited 0.025s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:28 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[780519bc-5af1-4ab7-ae32-7ec0a9474b8c]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:28 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 Sep 23 00:34:28 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:28 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5" returned: 0 in 0.470s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:28 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:28 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5 Sep 23 00:34:28 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:29 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-e38d04c6-7530-4198-b2a2-cc5f591b1bf5" returned: 0 in 0.338s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-e38d04c6-7530-4198-b2a2-cc5f591b1bf5" released by "delete_volume" :: held 0.891s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:29 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Created reservations ['295ea9f8-6cd9-4dc6-82ac-8b99dd812d2e', '9822355f-cf45-496c-af02-9c1bc0f38c47', '2d9ba7dc-f3fb-4539-b657-dcdc0865752b', '1310f960-8117-4b8b-8707-e13e9c57d040'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:29 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:29 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:34:29 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:29 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:29 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.346s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:29 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:29 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Deleted volume successfully. Sep 23 00:34:29 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-9e2e0240-bbdc-4d40-b2ea-88ccdbd581f5 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-e38d04c6-7530-4198-b2a2-cc5f591b1bf5-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (e0917e6b-003f-4f5d-8f06-c239873b9a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1792d5-663a-43f8-be12-c55044717329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1792d5-663a-43f8-be12-c55044717329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-585581460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb1de02-0e95-4a1a-ad61-651b59c6be07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:30Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786442f0-2b22-4f1f-bf91-3b2d9392e199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786442f0-2b22-4f1f-bf91-3b2d9392e199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b081af-7878-4a66-97fb-b5c3f6a471a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b081af-7878-4a66-97fb-b5c3f6a471a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb1de02-0e95-4a1a-ad61-651b59c6be07', 'volume_name': 'volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0816a1-95ff-4cf0-bd00-65a21815c4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0816a1-95ff-4cf0-bd00-65a21815c4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381e37f5-6094-43ee-8d5b-c5e04577877e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:30 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Volume 9bb1de02-0e95-4a1a-ad61-651b59c6be07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07', 'volume_size': 1} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-585581460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb1de02-0e95-4a1a-ad61-651b59c6be07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:30Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Creating volume 9bb1de02-0e95-4a1a-ad61-651b59c6be07 {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:30 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:30 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 1073741824 Sep 23 00:34:30 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:30 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 1073741824" returned: 0 in 0.528s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:30 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:30 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 Sep 23 00:34:30 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:31 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07" returned: 0 in 0.392s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:31 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:31 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381e37f5-6094-43ee-8d5b-c5e04577877e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2425449f-88c6-4d1a-895f-fd734182cb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:31 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Volume volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 (9bb1de02-0e95-4a1a-ad61-651b59c6be07): created successfully Sep 23 00:34:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2425449f-88c6-4d1a-895f-fd734182cb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:31 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (e0917e6b-003f-4f5d-8f06-c239873b9a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:31 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-0e762820-e74a-4e21-a8ae-4edb9ca0a6fd tempest-ProjectMemberTests-1420876395 None] Created volume successfully. Sep 23 00:34:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:32 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] Creating offline snapshot d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 of volume 9bb1de02-0e95-4a1a-ad61-651b59c6be07 {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:34:32 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc924fb2-4689-4a59-bbe7-3f53845006f6]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:32 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:32 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 Sep 23 00:34:32 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:33 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07" returned: 0 in 0.562s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:33 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 1G Sep 23 00:34:33 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:33 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 1G" returned: 0 in 0.591s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:33 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:33 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 Sep 23 00:34:33 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:34 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3" returned: 0 in 0.392s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:34 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 is being set with open permissions: ugo+rw Sep 23 00:34:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:34 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 Sep 23 00:34:34 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:34 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3" returned: 0 in 0.272s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:34 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.info Sep 23 00:34:34 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:34 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.info" returned: 0 in 0.349s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:34 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.info is being set with open permissions: ugo+rw Sep 23 00:34:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:34 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.info Sep 23 00:34:34 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:34 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.info" returned: 0 in 0.287s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:34 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.577s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:35 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-525b8f15-6b5e-41f6-974e-3eb5750729af tempest-ProjectMemberTests-1420876395 None] Create snapshot completed successfully Sep 23 00:34:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-d111cb2f-2c7a-4b2c-9980-fbfb42515ee3-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-d111cb2f-2c7a-4b2c-9980-fbfb42515ee3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-9bb1de02-0e95-4a1a-ad61-651b59c6be07" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-9bb1de02-0e95-4a1a-ad61-651b59c6be07" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-d111cb2f-2c7a-4b2c-9980-fbfb42515ee3" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:35 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-d111cb2f-2c7a-4b2c-9980-fbfb42515ee3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Deleting offline snapshot d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 of volume 9bb1de02-0e95-4a1a-ad61-651b59c6be07 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:35 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] snapshot_file for this snap is: volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:35 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5ee094-2cca-460f-b6d6-0d79c8827a17]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:35 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:35 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 Sep 23 00:34:35 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:36 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3" returned: 0 in 0.435s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:36 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:36 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa3c519-bed4-408f-846c-81f14d06a577]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:36 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 Sep 23 00:34:36 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:36 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07" returned: 0 in 0.396s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:36 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 Sep 23 00:34:36 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:36 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3" returned: 0 in 0.358s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:36 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:36 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3 Sep 23 00:34:36 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:37 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07.d111cb2f-2c7a-4b2c-9980-fbfb42515ee3" returned: 0 in 0.278s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-d111cb2f-2c7a-4b2c-9980-fbfb42515ee3" released by "_delete_snapshot" :: held 1.578s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-9bb1de02-0e95-4a1a-ad61-651b59c6be07" released by "delete_snapshot" :: held 1.603s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:37 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Created reservations ['ce50948b-79a8-48bb-aa57-50a72e5d2c89', 'a3dc2b00-b0d2-457b-8106-43472e53e93e', '66275c90-60e7-4df9-9c61-8fb39ca04a55', '0cc7ddc7-6449-4ba2-aad1-04fa3dcc00c2'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:37 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Delete snapshot completed successfully. Sep 23 00:34:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d1f423b4-2724-44f0-ae45-ce85334e80a1 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-d111cb2f-2c7a-4b2c-9980-fbfb42515ee3-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-9bb1de02-0e95-4a1a-ad61-651b59c6be07-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-9bb1de02-0e95-4a1a-ad61-651b59c6be07-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-9bb1de02-0e95-4a1a-ad61-651b59c6be07" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:37 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-9bb1de02-0e95-4a1a-ad61-651b59c6be07" acquired by "delete_volume" :: waited 0.018s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:37 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[627a5f62-379b-4a5b-a202-5e2a737e614a]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:37 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:38 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 Sep 23 00:34:38 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:38 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07" returned: 0 in 0.400s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:38 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07 Sep 23 00:34:38 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:38 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-9bb1de02-0e95-4a1a-ad61-651b59c6be07" returned: 0 in 0.268s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:38 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-9bb1de02-0e95-4a1a-ad61-651b59c6be07" released by "delete_volume" :: held 0.740s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:38 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Created reservations ['a9e6cbf1-1cda-48cc-ba48-7eef83bafc4a', 'a4c0dc5b-20ad-4b8e-bbf0-5d07608ed7a8', '964de4da-a514-4493-bcfd-2bfb37c401af', '0b65df37-815f-4dd6-9344-94fccfaa7bbd'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:38 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:38 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:38 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:34:38 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:39 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.307s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:39 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Deleted volume successfully. Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-709f2f7d-18cd-4293-a294-aabed6ba7750 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-9bb1de02-0e95-4a1a-ad61-651b59c6be07-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.flows.manager.create_volume [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86481) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (284d7c65-459b-4991-8007-75e2e8837dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feec9169-087a-4418-9079-36bea5e6a147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feec9169-087a-4418-9079-36bea5e6a147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156210011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f21650-dbb9-431f-a5e5-4434e3789aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:39Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb67751c-99a6-427e-b81d-85465d1cf012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb67751c-99a6-427e-b81d-85465d1cf012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbc09ba-1b53-4118-8fe8-08ef3fce1565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbc09ba-1b53-4118-8fe8-08ef3fce1565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f21650-dbb9-431f-a5e5-4434e3789aef', 'volume_name': 'volume-26f21650-dbb9-431f-a5e5-4434e3789aef', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389ddd5e-b3c7-42ee-b43d-ec4836259e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389ddd5e-b3c7-42ee-b43d-ec4836259e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8e354a-00eb-4929-b16a-a656a3f42b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:39 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Volume 26f21650-dbb9-431f-a5e5-4434e3789aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f21650-dbb9-431f-a5e5-4434e3789aef', 'volume_size': 1} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156210011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f21650-dbb9-431f-a5e5-4434e3789aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea190d2614e949f1b992b44ecea8f8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:39Z,use_quota=True,user_id='028c771eec2844bf948f70251527d716',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67e3b6ad-5bba-4f4a-b264-4f3a2b88078c),volume_type_id=67e3b6ad-5bba-4f4a-b264-4f3a2b88078c)}" {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Creating volume 26f21650-dbb9-431f-a5e5-4434e3789aef {{(pid=86481) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Selected osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 as target Quobyte volume. {{(pid=86481) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:39 devstack cinder-volume[86481]: INFO cinder.volume.drivers.remotefs [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] casted to osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21 Sep 23 00:34:39 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef 1073741824 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:39 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef 1073741824 Sep 23 00:34:39 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:40 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef 1073741824" returned: 0 in 0.480s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:40 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef Sep 23 00:34:40 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:40 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef" returned: 0 in 0.280s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:40 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'} {{(pid=86481) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:40 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8e354a-00eb-4929-b16a-a656a3f42b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f21650-dbb9-431f-a5e5-4434e3789aef', 'volume_size': 1}' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb2eaab-8e2a-4fa2-83de-c6200a969ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:40 devstack cinder-volume[86481]: INFO cinder.volume.flows.manager.create_volume [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Volume volume-26f21650-dbb9-431f-a5e5-4434e3789aef (26f21650-dbb9-431f-a5e5-4434e3789aef): created successfully Sep 23 00:34:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb2eaab-8e2a-4fa2-83de-c6200a969ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86481) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:40 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Flow 'volume_create_manager' (284d7c65-459b-4991-8007-75e2e8837dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86481) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:40 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d044a14f-ce4a-4f0d-b8ba-fbd3cff2771d tempest-ProjectMemberTests-1420876395 None] Created volume successfully. Sep 23 00:34:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:41 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] Creating offline snapshot 29ee9beb-1a90-4831-a2e6-e3c24cf56a72 of volume 26f21650-dbb9-431f-a5e5-4434e3789aef {{(pid=86481) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:34:41 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ea790f-7dca-4100-b52e-97e3a6c15979]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:41 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:42 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef Sep 23 00:34:42 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:42 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef" returned: 0 in 0.443s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 1G {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:42 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 1G Sep 23 00:34:42 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:42 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 1G" returned: 0 in 0.540s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:42 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26f21650-dbb9-431f-a5e5-4434e3789aef -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:42 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26f21650-dbb9-431f-a5e5-4434e3789aef -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 Sep 23 00:34:42 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:43 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26f21650-dbb9-431f-a5e5-4434e3789aef -F qcow2 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72" returned: 0 in 0.335s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:43 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 is being set with open permissions: ugo+rw Sep 23 00:34:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:43 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 Sep 23 00:34:43 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:43 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72" returned: 0 in 0.280s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:43 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.info Sep 23 00:34:43 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:43 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.info" returned: 0 in 0.279s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:43 devstack cinder-volume[86481]: WARNING cinder.volume.drivers.remotefs [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.info is being set with open permissions: ugo+rw Sep 23 00:34:43 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.info {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:43 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.info Sep 23 00:34:43 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:44 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.info" returned: 0 in 0.291s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.268s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:44 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-1edd3084-6a83-400e-8a02-1e181cca528f tempest-ProjectMemberTests-1420876395 None] Create snapshot completed successfully Sep 23 00:34:44 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:34:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:44 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:44 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:45 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:34:45 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:45 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.324s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-29ee9beb-1a90-4831-a2e6-e3c24cf56a72-delete_snapshot" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG oslo_service.periodic_task [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] Running periodic task VolumeManager._thread_info {{(pid=86481) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread count: 28 {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG cinder.volume.manager [None req-55e3a8d1-ecdd-4f88-8dd8-a5e6cdf14afd None None] thread info: [<_MainThread(MainThread, started 132029429149824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86481) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-29ee9beb-1a90-4831-a2e6-e3c24cf56a72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-26f21650-dbb9-431f-a5e5-4434e3789aef" by "delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-26f21650-dbb9-431f-a5e5-4434e3789aef" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-29ee9beb-1a90-4831-a2e6-e3c24cf56a72" by "_delete_snapshot" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-29ee9beb-1a90-4831-a2e6-e3c24cf56a72" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Deleting offline snapshot 29ee9beb-1a90-4831-a2e6-e3c24cf56a72 of volume 26f21650-dbb9-431f-a5e5-4434e3789aef {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] snapshot_file for this snap is: volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 {{(pid=86481) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90abdfc-61e6-412f-a83c-f915747b4a66]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:45 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 Sep 23 00:34:45 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:45 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72" returned: 0 in 0.400s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.remotefs [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26f21650-dbb9-431f-a5e5-4434e3789aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86481) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[11069e92-19c2-40e9-a14f-78c624733de8]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:45 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef Sep 23 00:34:46 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:46 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef" returned: 0 in 0.416s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 Sep 23 00:34:46 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:46 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72" returned: 0 in 0.395s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:46 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:46 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72 Sep 23 00:34:46 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:47 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef.29ee9beb-1a90-4831-a2e6-e3c24cf56a72" returned: 0 in 0.321s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-29ee9beb-1a90-4831-a2e6-e3c24cf56a72" released by "_delete_snapshot" :: held 1.658s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-26f21650-dbb9-431f-a5e5-4434e3789aef" released by "delete_snapshot" :: held 1.687s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:47 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Created reservations ['919df007-82ae-4692-9c61-27b00ac9c259', 'bddaa70a-4c0a-4647-82eb-405cd83889a9', '4b061888-5658-49e4-8fbd-a51126c63558', '1e5df72d-62c3-46af-88df-fcf906763220'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:47 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Delete snapshot completed successfully. Sep 23 00:34:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-2a8ed532-7ef3-4bda-8947-cbbbc8635ab3 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-29ee9beb-1a90-4831-a2e6-e3c24cf56a72-delete_snapshot" released by "delete_snapshot" :: held 1.857s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-26f21650-dbb9-431f-a5e5-4434e3789aef-delete_volume" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-26f21650-dbb9-431f-a5e5-4434e3789aef-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "cinder-quobyte-26f21650-dbb9-431f-a5e5-4434e3789aef" by "delete_volume" {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:47 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-26f21650-dbb9-431f-a5e5-4434e3789aef" acquired by "delete_volume" :: waited 0.017s {{(pid=86481) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:47 devstack cinder-volume[86481]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe2bee1-d986-4178-b8cd-cc66775cd36f]: (4, 'qcow2') {{(pid=87550) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:47 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:47 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef Sep 23 00:34:47 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:48 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef" returned: 0 in 0.390s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:48 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef Sep 23 00:34:48 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:48 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7/volume-26f21650-dbb9-431f-a5e5-4434e3789aef" returned: 0 in 0.259s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-quobyte-26f21650-dbb9-431f-a5e5-4434e3789aef" released by "delete_volume" :: held 0.728s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG cinder.quota [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Created reservations ['bb5868eb-97fe-4898-aa9a-41cbd873c29c', '62e9c10b-e196-48d7-9fff-f27212a52d20', 'bf5317cc-ea0a-4442-8861-9f7418762b1d', 'c67a4119-6ef1-4805-82e5-ae890fd592f6'] {{(pid=86481) reserve /opt/stack/cinder/cinder/quota.py:763}} Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21': None} {{(pid=86481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG cinder.volume.drivers.quobyte [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-12c1ad34-ae4f-4da5-9cc4-19e73f3baa21'] {{(pid=86481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.lockutils [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:48 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7 Sep 23 00:34:48 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:48 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG oslo_concurrency.processutils [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5d6e550d2b2a5a317f3d67e92ef510f7" returned: 0 in 0.309s {{(pid=86481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG cinder.manager [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Notifying Schedulers of capabilities ... {{(pid=86481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:48 devstack cinder-volume[86481]: INFO cinder.volume.manager [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Deleted volume successfully. Sep 23 00:34:48 devstack cinder-volume[86481]: DEBUG cinder.coordination [None req-d3c7303b-daa3-4d07-85b0-21b221906df7 tempest-ProjectMemberTests-1420876395 None] Lock "cinder-26f21650-dbb9-431f-a5e5-4434e3789aef-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86481) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:58 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=101,cinder:INSERT=36,cinder:UPDATE=143,cinder:DELETE=10 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:58 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=104,cinder:UPDATE=133,cinder:INSERT=37,cinder:DELETE=13 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:15 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:SELECT=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:15 devstack cinder-volume[86481]: DEBUG dbcounter [-] [86481] Writing DB stats cinder:UPDATE=1 {{(pid=86481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}